00000001:02000400:0.0F:1788793028.809671:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788793046.055540:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788793048.010220:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 454 MB/s 00000001:01000000:0.0:1788793048.261540:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 633 MB/s 00000001:01000000:2.0F:1788793048.512404:0:3247:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3896 MB/s 00000020:02000000:0.0:1788793049.546720:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gec2d9e5 00000400:02000000:0.0:1788793050.624633:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.106@tcp [8/256/0/180] 00008000:02000000:0.0:1788793054.399126:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788793110.102299:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788793120.250099:0:5815:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788793120.250104:0:5815:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788793120.250416:0:5815:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000071508f31 00000080:02000400:2.0:1788793120.250427:0:5815:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788793120.257683:0:5815:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788793120.257698:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788793120.257750:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d883c958) 00000020:00000080:2.0:1788793120.257773:0:5815:0:(obd_config.c:716:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788793120.281009:0:5815:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788793120.283130:0:5815:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788793120.380178:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788793120.380219:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788793120.380241:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788793120.380292:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788793120.380320:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788793120.380675:0:5815:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788793120.380683:0:5815:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788793120.380692:0:5815:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cb81 00000020:01000004:2.0:1788793120.380700:0:5815:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788793120.380705:0:5815:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788793120.380722:0:5815:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000071508f31 from MGS 00000020:01000004:2.0:1788793120.380728:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788793120.380738:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000578e4b6a) 00000020:00000080:2.0:1788793120.380748:0:5815:0:(obd_config.c:716:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788793120.380793:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071508f31 from MGS, refs=2 00080000:01000000:2.0:1788793120.380797:0:5815:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788793120.380803:0:5815:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cb8f 00000100:00100000:2.0:1788793120.380897:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788793120.381032:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788793120.381038:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788793120.390760:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788793120.390777:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788793120.392779:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793120.392953:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788793120.392959:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788793120.393562:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788793120.393569:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788793120.395839:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788793120.395851:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788793120.396942:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793120.396946:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793120.396948:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793120.398756:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793120.398761:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793120.398763:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793120.399917:0:5815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788793120.406921:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788793120.649533:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3031 MB/s 00000001:01000000:2.0:1788793120.902013:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3158 MB/s 00000001:01000000:0.0:1788793121.152582:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 474 MB/s 00000001:01000000:2.0:1788793121.402978:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 500 MB/s 00080000:10000000:3.0:1788793121.418863:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788793121.424364:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788793121.444098:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788793121.444125:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788793121.444128:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788793121.447343:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788793121.449714:0:5815:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788793121.449792:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788793121.450095:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788793121.450121:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788793121.454958:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793121.455173:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788793121.455180:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788793121.463891:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788793121.463914:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788793121.464768:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788793121.464776:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788793121.465248:0:5815:0:(obd_config.c:813:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788793121.465268:0:5815:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.106@tcp' 00000020:01000004:0.0:1788793121.465270:0:5815:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:2.0:1788793121.465448:0:5831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1788793121.466046:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.106@tcp (typ=mgc) 00000020:00000080:0.0:1788793121.466066:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.106@tcp (000000008c6dd886) 00000020:00000080:0.0:1788793121.466085:0:5815:0:(obd_config.c:716:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788793121.466193:0:5815:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008d39e145@MGC192.168.201.106@tcp: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788793121.467039:0:5815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.106@tcp-0 is initialized 00000040:01000000:0.0:1788793121.467046:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788793121.475313:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788793121.475517:0:5815:0:(obd_config.c:813:class_setup()) finished setup of obd MGC192.168.201.106@tcp (uuid 73b0aaed-ca5a-4e64-8a6f-f63481662d2e) 00000020:00000080:0.0:1788793121.475548:0:5815:0:(genops.c:1375:class_connect()) connect: client 73b0aaed-ca5a-4e64-8a6f-f63481662d2e, cookie 0xa112893a8a83cb9d 00000100:00080000:0.0:1788793121.475560:0:5815:0:(import.c:545:import_select_connection()) MGC192.168.201.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788793121.475571:0:5815:0:(import.c:666:import_select_connection()) MGC192.168.201.106@tcp: import 000000008d39e145 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788793121.475617:0:5815:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007a139bad x1875685461196928/t0(0) o250->MGC192.168.201.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788793121.475646:0:5815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 73b0aaed-ca5a-4e64-8a6f-f63481662d2e->MGS 00000020:01000004:0.0:1788793121.475669:0:5815:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788793121.475675:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788793121.475688:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a9eb490) 00000020:00000080:0.0:1788793121.475710:0:5815:0:(obd_config.c:716:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788793121.476727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a139bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3307:1875685461196928:0@lo:250: 00000100:00100000:2.0:1788793121.476814:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793121.485220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461196928 00000100:00100000:3.0:1788793121.485233:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461196928 00000100:00100000:3.0:1788793121.485291:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793121.485298:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b198ed1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3307:x1875685461196928:12345-0@lo:250: 00010000:00080000:3.0:1788793121.485326:0:5829:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 73b0aaed-ca5a-4e64-8a6f-f63481662d2e@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:3.0:1788793121.485355:0:5829:0:(genops.c:1375:class_connect()) connect: client 73b0aaed-ca5a-4e64-8a6f-f63481662d2e, cookie 0xa112893a8a83cbab 00000100:00080000:3.0:1788793121.485476:0:5829:0:(import.c:65:import_set_state_nolock()) 0000000008eca0ea : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793121.485566:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b198ed1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:3307:x1875685461196928:12345-0@lo:250: Request processed in 268us (8752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793121.485575:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793121.485627:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788793121.485636:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.106@tcp: connect to target with instance 0 00000100:00080000:3.0:1788793121.485643:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788793121.485647:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788793121.485649:0:3307:0:(import.c:65:import_set_state_nolock()) 000000008d39e145 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788793121.485651:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788793121.485661:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788793121.485665:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a139bad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3307:1875685461196928:0@lo:250: 00000100:00100000:0.0:1788793121.492254:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793121.492877:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788793121.492884:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788793121.496563:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788793121.496578:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788793121.497003:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788793121.497009:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788793121.497945:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788793121.498118:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788793121.498124:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788793121.499083:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788793121.499091:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788793121.543807:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793121.545019:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788793121.545028:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788793121.553531:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788793121.553546:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788793121.559744:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793121.560246:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788793121.560253:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788793121.568610:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788793121.568630:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788793121.569647:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793121.569827:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788793121.569832:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788793121.571864:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788793121.571877:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788793121.573526:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793121.573725:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788793121.573732:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788793121.574469:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788793121.574477:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788793121.621004:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788793121.621612:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788793121.621620:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788793121.627973:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788793121.627988:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788793121.629662:0:5815:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788793121.629674:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788793121.635239:0:5815:0:(obd_config.c:813:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788793121.635276:0:5815:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788793121.635282:0:5815:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788793121.635549:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788793121.635589:0:5815:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788793121.635593:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788793121.635595:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788793121.635596:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793121.635597:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793121.635598:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793121.635599:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793121.635600:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788793121.635602:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788793121.635603:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793121.635604:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793121.635605:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793121.635606:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788793121.635608:0:5815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788793121.635611:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788793121.635612:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788793121.635613:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793121.635614:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793121.635620:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793121.635621:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793121.635622:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788793121.635622:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788793121.635623:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793121.635624:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793121.635625:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793121.635626:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788793121.635674:0:5815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788793121.635703:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000943b3ca8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197056:0@lo:253: 00000100:00100000:1.0:1788793121.635783:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793121.635897:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d813dab4 going to sleep for 11 seconds 00000100:00100000:2.0:1788793121.638739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197056 00000100:00100000:2.0:1788793121.638755:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197056 00000100:00100000:2.0:1788793121.638819:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793121.638828:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008631a672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:5815:x1875685461197056:12345-0@lo:253: 20000000:01000000:2.0:1788793121.638890:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788793121.638898:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788793121.639406:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788793121.639520:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788793121.639810:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793121.644766:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788793121.645103:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788793121.645109:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788793121.645116:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788793121.645119:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788793121.645165:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788793121.645456:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793121.645698:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788793121.645712:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788793121.645762:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788793121.645810:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788793121.645847:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788793121.645933:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788793121.645943:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788793121.645987:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788793121.645995:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788793121.646024:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788793121.646032:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788793121.646060:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788793121.646107:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788793121.646137:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788793121.646168:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788793121.646184:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793121.646375:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788793121.646385:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788793121.646417:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788793121.646454:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788793121.646502:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788793121.646513:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788793121.646584:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788793121.646592:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788793121.646637:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788793121.646706:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788793121.646744:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788793121.646753:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788793121.646832:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788793121.646840:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788793121.646872:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788793121.646902:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788793121.647052:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788793121.647104:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788793121.647111:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788793121.653557:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788793121.654752:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788793121.654789:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.106@tcp for mdt 20000000:01000000:0.0:1788793121.654791:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788793121.654828:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788793121.654837:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788793121.654865:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788793121.654873:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788793121.654919:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788793121.654930:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788793121.654964:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788793121.655002:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788793121.655084:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788793121.655098:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788793121.655103:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788793121.655110:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788793121.655995:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788793121.656110:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788793121.665823:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788793121.665875:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788793121.665952:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788793121.665972:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788793121.665975:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788793121.665979:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788793121.665992:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788793121.665995:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788793121.666025:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788793121.666027:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788793121.671008:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1788793121.671598:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1788793121.671645:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1788793121.671749:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1788793121.671767:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788793121.671770:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788793121.672389:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788793121.672743:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788793121.672783:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788793121.672814:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788793121.672827:0:5830:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793121.672830:0:5830:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1788793121.672837:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788793121.672857:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672873:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672884:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672890:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672905:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672911:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672917:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d499bcf already unused, calling callback (000000009654bdcb) 00010000:00010000:2.0:1788793121.672920:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672928:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672940:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672947:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793121.672953:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d499bcf/0xa112893a8a83cbb2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788793121.672973:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788793122.016222:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008631a672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:5815:x1875685461197056:12345-0@lo:253: Request processed in 377389us (380432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793122.016242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788793122.016527:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000943b3ca8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197056:0@lo:253: 10000000:01000000:3.0:1788793122.016544:0:5815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788793122.016547:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788793122.016549:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788793122.016551:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793122.016552:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788793122.016553:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793122.016555:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793122.016556:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788793122.016557:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788793122.016559:0:5815:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788793122.016560:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793122.016561:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788793122.016658:0:5815:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000071508f31 from lustre-MDT0000 10000000:01000000:2.0:1788793122.016693:0:5815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788793122.016696:0:5815:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788793122.016700:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff926488538000 10000000:01000000:2.0:1788793122.016704:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793122.016712:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff926488538000 from 1 10000000:01000000:2.0:1788793122.016715:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788793122.016771:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.016782:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.016791:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.016807:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a61c376f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197184:0@lo:101: 00000100:00100000:2.0:1788793122.016844:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.016936:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037e5b753 going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.017022:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197184 00000100:00100000:3.0:1788793122.017028:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197184 00000100:00100000:3.0:1788793122.017210:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788793122.017219:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fc0b6fb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:5815:x1875685461197184:12345-0@lo:101: 00010000:00010000:3.0:1788793122.017231:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.017244:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006bb5b1d4/0xa112893a8a83cbc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cbb9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.017267:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006bb5b1d4/0xa112893a8a83cbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.017276:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006bb5b1d4/0xa112893a8a83cbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.017296:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006bb5b1d4, rc 0) 00000100:00100000:3.0:1788793122.017339:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fc0b6fb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5815:x1875685461197184:12345-0@lo:101: Request processed in 121us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.017345:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793122.017407:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a61c376f pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197184:0@lo:101: 00010000:00010000:1.0:1788793122.017420:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.017429:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793122.017497:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197312:0@lo:501: 00000100:00100000:1.0:1788793122.017532:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.017660:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000001243b1d4 going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.017865:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197312 00000100:00100000:2.0:1788793122.017870:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197312 00000100:00100000:2.0:1788793122.017893:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793122.017899:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a37dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5815:x1875685461197312:12345-0@lo:501: 00000100:00100000:2.0:1788793122.018171:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a37dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5815:x1875685461197312:12345-0@lo:501: Request processed in 272us (638us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793122.018179:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788793122.018313:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197312:0@lo:501: 10000000:01000000:1.0:1788793122.018336:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788793122.018354:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.018364:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000009d499bcf/0xa112893a8a83cbb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793122.018372:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff926488cd7800 10000000:01000000:1.0:1788793122.018376:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788793122.018380:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff926488cd7800 10000000:01000000:1.0:1788793122.018382:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788793122.018384:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff926488cd7800 from 1 10000000:01000000:1.0:1788793122.018387:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788793122.018405:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.018412:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.018419:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793122.018431:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197440:0@lo:101: 00000100:00100000:1.0:1788793122.018588:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.018711:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000001243b1d4 going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.018761:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197440 00000100:00100000:3.0:1788793122.018766:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197440 00000100:00100000:3.0:1788793122.018787:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788793122.018793:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6e4a758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5815:x1875685461197440:12345-0@lo:101: 00010000:00010000:3.0:1788793122.018800:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.018811:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ac9de31/0xa112893a8a83cbce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cbc7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.018826:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ac9de31/0xa112893a8a83cbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cbc7 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.018835:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ac9de31/0xa112893a8a83cbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cbc7 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.018841:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ac9de31, rc 0) 00000100:00100000:3.0:1788793122.018917:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6e4a758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+7:5815:x1875685461197440:12345-0@lo:101: Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.018923:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793122.019008:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197440:0@lo:101: 00010000:00010000:1.0:1788793122.019018:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.019025:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cbce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793122.019035:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788793122.019051:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.019232:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000c8504cdc/0xa112893a8a83cbc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbce expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793122.019240:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788793122.019244:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788793122.019248:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff926488cd7800 10000000:01000000:1.0:1788793122.019251:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788793122.019253:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788793122.019255:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788793122.019269:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.019275:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.019282:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793122.019300:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197568:0@lo:101: 00000100:00100000:1.0:1788793122.019324:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.019351:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000001243b1d4 going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.019397:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197568 00000100:00100000:3.0:1788793122.019402:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197568 00000100:00100000:3.0:1788793122.019520:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788793122.019528:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eaf65aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+7:5815:x1875685461197568:12345-0@lo:101: 00010000:00010000:3.0:1788793122.019535:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.019550:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000adbf0315/0xa112893a8a83cbdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cbd5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.019563:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000adbf0315/0xa112893a8a83cbdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.019569:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000adbf0315/0xa112893a8a83cbdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.019574:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000adbf0315, rc 0) 00000100:00100000:3.0:1788793122.019608:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eaf65aba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+8:5815:x1875685461197568:12345-0@lo:101: Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.019614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788793122.019693:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197568:0@lo:101: 00010000:00010000:1.0:1788793122.019704:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.019711:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793122.019746:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197696:0@lo:501: 00000100:00100000:1.0:1788793122.019770:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.019858:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000001243b1d4 going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.019892:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197696 00000100:00100000:2.0:1788793122.019896:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197696 00000100:00100000:2.0:1788793122.019917:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788793122.019922:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000248bcb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+8:5815:x1875685461197696:12345-0@lo:501: 00000100:00100000:2.0:1788793122.020186:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000248bcb19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5815:x1875685461197696:12345-0@lo:501: Request processed in 263us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.020192:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788793122.020337:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197696:0@lo:501: 00000100:00100000:1.0:1788793122.020363:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197824:0@lo:503: 00000100:00100000:1.0:1788793122.020398:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.020456:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000001243b1d4 going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.020670:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197824 00000100:00100000:3.0:1788793122.020674:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197824 00000100:00100000:2.0:1788793122.020722:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788793122.020728:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000030e1cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5815:x1875685461197824:12345-0@lo:503: 00000100:00100000:2.0:1788793122.020888:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000030e1cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5815:x1875685461197824:12345-0@lo:503: Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.020894:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793122.020971:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461197824:0@lo:503: 00000100:00100000:2.0:1788793122.021589:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5858:1875685461197952:0@lo:502: 00000100:00100000:2.0:1788793122.021629:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.021702:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037e5b753 going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.021741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461197952 00000100:00100000:3.0:1788793122.021746:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461197952 00000100:00100000:3.0:1788793122.021814:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788793122.021822:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0211b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5858:x1875685461197952:12345-0@lo:502: 00000100:00100000:3.0:1788793122.021980:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0211b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5858:x1875685461197952:12345-0@lo:502: Request processed in 159us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.021987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788793122.022050:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5858:1875685461197952:0@lo:502: 00000020:01000000:2.0:1788793122.022083:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793122.022094:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793122.022096:0:5858:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788793122.022100:0:5858:0:(obd_config.c:1951:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788793122.022103:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793122.022116:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000059948866) 00000020:00000080:2.0:1788793122.022132:0:5858:0:(obd_config.c:716:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788793122.022137:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788793122.022222:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788793122.022229:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cbea 00000020:00000080:2.0:1788793122.022485:0:5858:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788793122.022490:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793122.022493:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793122.022495:0:5858:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788793122.022497:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793122.022501:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793122.022502:0:5858:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788793122.022506:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788793122.022512:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000086315c73) 00000020:00000080:2.0:1788793122.022522:0:5858:0:(obd_config.c:716:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788793122.022526:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788793122.022528:0:5858:0:(obd_config.c:1500:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788793122.022530:0:5858:0:(obd_config.c:1133:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788793122.022542:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788793122.022579:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071508f31 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788793122.022598:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000089c522d6) 00000020:00000080:2.0:1788793122.022608:0:5858:0:(obd_config.c:716:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788793122.022661:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788793122.022666:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa112893a8a83cbff 00000020:00000080:2.0:1788793122.022754:0:5858:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788793122.022760:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788793122.022765:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa112893a8a83cc06 00080000:01000000:2.0:1788793122.022769:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788793122.022772:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cc0d 00080000:10000000:2.0:1788793122.023125:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788793122.023395:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788793122.027365:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788793122.082720:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788793122.083298:0:5858:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788793122.085716:0:5858:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788793122.085985:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788793122.109371:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000076181e1a) 00000020:00000080:3.0:1788793122.109394:0:5858:0:(obd_config.c:716:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788793122.109500:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788793122.109507:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cc1b 00000020:00000080:2.0:1788793122.113417:0:5858:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788793122.114624:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.144575:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788793122.163263:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788793122.182986:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788793122.208884:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788793122.232295:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788793122.268631:0:5858:0:(genops.c:1375:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa112893a8a83cc22 00000020:00000080:1.0:1788793122.269014:0:5858:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788793122.269025:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793122.269031:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793122.269033:0:5858:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788793122.269036:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793122.269041:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793122.269047:0:5858:0:(obd_config.c:1547:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788793122.269051:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788793122.269086:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788793122.269100:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793122.269103:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793122.269105:0:5858:0:(obd_config.c:1547:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788793122.269107:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793122.269110:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793122.269111:0:5858:0:(obd_config.c:1547:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788793122.269114:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793122.269115:0:5858:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788793122.269166:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5858:1875685461198080:0@lo:502: 00000100:00100000:1.0:1788793122.269229:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.269282:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000286f6a21 going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.269286:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198080 00000100:00100000:2.0:1788793122.269293:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198080 00000100:00100000:2.0:1788793122.269337:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793122.269345:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046349351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5858:x1875685461198080:12345-0@lo:502: 00000100:00100000:2.0:1788793122.269619:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046349351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5858:x1875685461198080:12345-0@lo:502: Request processed in 274us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.269627:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788793122.269796:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5858:1875685461198080:0@lo:502: 00000020:01000000:1.0:1788793122.269821:0:5858:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793122.269825:0:5858:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793122.269826:0:5858:0:(obd_config.c:1547:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788793122.269829:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788793122.269968:0:5815:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788793122.269986:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788793122.270038:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.270065:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 000000009f312c15/0xa112893a8a83cbd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793122.270074:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926488cd7800 from 1 10000000:01000000:2.0:1788793122.270077:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788793122.270101:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.270108:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.270115:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.270127:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198208:0@lo:101: 00000100:00100000:2.0:1788793122.270177:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.270197:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ef306ec going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.270419:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198208 00000100:00100000:3.0:1788793122.270425:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198208 00000100:00100000:3.0:1788793122.270460:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793122.270466:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012008f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:5815:x1875685461198208:12345-0@lo:101: 00010000:00010000:3.0:1788793122.270476:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.270489:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cc29 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.270508:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.270518:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.270524:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005dd18b7e, rc 0) 00000100:00100000:3.0:1788793122.270553:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012008f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:5815:x1875685461198208:12345-0@lo:101: Request processed in 88us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.270559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788793122.270580:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198208:0@lo:101: 00010000:00010000:2.0:1788793122.270591:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.270598:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.271166:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198336:0@lo:256: 00000100:00100000:2.0:1788793122.271201:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.271221:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ef306ec going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.271239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198336 00000100:00100000:2.0:1788793122.271243:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198336 00000100:00100000:2.0:1788793122.271264:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793122.271268:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c1f09acc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:5815:x1875685461198336:12345-0@lo:256: 20000000:01000000:2.0:1788793122.271350:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788793122.271356:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788793122.271413:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c1f09acc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:5815:x1875685461198336:12345-0@lo:256: Request processed in 144us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.271420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793122.271449:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198336:0@lo:256: 10000000:01000000:2.0:1788793122.271959:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788793122.271973:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.271983:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793122.271990:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926488cd7800 from 1 10000000:01000000:2.0:1788793122.271992:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788793122.272010:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.272017:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.272023:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.272034:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198464:0@lo:101: 00000100:00100000:2.0:1788793122.272114:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.272130:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ef306ec going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.272225:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198464 00000100:00100000:3.0:1788793122.272230:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198464 00000100:00100000:3.0:1788793122.272254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788793122.272259:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a436b8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:5815:x1875685461198464:12345-0@lo:101: 00010000:00010000:3.0:1788793122.272268:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.272278:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cc37 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.272295:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.272302:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.272435:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055fb6525, rc 0) 00000100:00100000:3.0:1788793122.272465:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a436b8ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198464:12345-0@lo:101: Request processed in 206us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.272471:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793122.272492:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198464:0@lo:101: 00010000:00010000:2.0:1788793122.272503:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.272511:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.272549:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198592:0@lo:501: 00000100:00100000:2.0:1788793122.272566:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793122.272587:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ef306ec going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.272665:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198592 00000100:00100000:3.0:1788793122.272670:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198592 00000100:00100000:3.0:1788793122.272703:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788793122.272709:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000126bd842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198592:12345-0@lo:501: 00000100:00100000:2.0:1788793122.273467:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198592:0@lo:501: 00000100:00100000:3.0:1788793122.273469:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000126bd842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198592:12345-0@lo:501: Request processed in 760us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.273476:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793122.273493:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198720:0@lo:503: 00000100:00100000:2.0:1788793122.273528:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.273546:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198720 00000100:00100000:2.0:1788793122.273549:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ef306ec going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.273551:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198720 00000100:00100000:3.0:1788793122.273574:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788793122.273580:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081c45e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198720:12345-0@lo:503: 00000040:00080000:3.0:1788793122.273690:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788793122.273734:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081c45e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198720:12345-0@lo:503: Request processed in 156us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.273741:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788793122.273808:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000971da744 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198720:0@lo:503: 00000040:00080000:1.0:1788793122.278107:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788793122.278405:0:5815:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788793122.278425:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788793122.278441:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278454:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793122.278524:0:5815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788793122.278527:0:5815:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff926488cd7800 10000000:01000000:3.0:1788793122.278530:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff926488cd7800 10000000:01000000:3.0:1788793122.278533:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788793122.278538:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926488cd7800 from 1 10000000:01000000:3.0:1788793122.278540:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788793122.278586:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278604:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278614:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793122.278633:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198848:0@lo:101: 00000100:00100000:3.0:1788793122.278703:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.278741:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000911789ef going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.278769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198848 00000100:00100000:3.0:1788793122.278777:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198848 00000100:00100000:3.0:1788793122.278819:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788793122.278827:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a305d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461198848:12345-0@lo:101: 00010000:00010000:3.0:1788793122.278840:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793122.278849:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bce4ca65/0xa112893a8a83cc4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cc45 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278871:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bce4ca65/0xa112893a8a83cc4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278891:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bce4ca65/0xa112893a8a83cc4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.278899:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bce4ca65, rc 0) 00000100:00100000:3.0:1788793122.278935:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a305d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461198848:12345-0@lo:101: Request processed in 108us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.278940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788793122.278985:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198848:0@lo:101: 00010000:00010000:3.0:1788793122.279004:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793122.279012:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793122.279070:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198976:0@lo:501: 00000100:00100000:3.0:1788793122.279094:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.279107:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000911789ef going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.279120:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461198976 00000100:00100000:3.0:1788793122.279124:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461198976 00000100:00100000:3.0:1788793122.279161:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788793122.279167:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c48b51f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461198976:12345-0@lo:501: 00000100:00100000:3.0:1788793122.279406:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c48b51f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461198976:12345-0@lo:501: Request processed in 239us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.279413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788793122.279444:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461198976:0@lo:501: 00000100:00100000:3.0:1788793122.279470:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461199104:0@lo:503: 00000100:00100000:3.0:1788793122.279509:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.279521:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000000671920d going to sleep for 11 seconds 00000100:00100000:3.0:1788793122.279534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199104 00000100:00100000:3.0:1788793122.279538:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199104 00000100:00100000:3.0:1788793122.279557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793122.279562:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b6e335d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461199104:12345-0@lo:503: 00000100:00100000:3.0:1788793122.279838:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b6e335d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461199104:12345-0@lo:503: Request processed in 274us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793122.279844:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793122.279895:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461199104:0@lo:503: 00000100:00100000:3.0:1788793122.280971:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5863:1875685461199232:0@lo:502: 00000100:00100000:3.0:1788793122.281024:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.281101:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ed68c83 going to sleep for 11 seconds 00000100:00100000:1.0:1788793122.281883:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199232 00000100:00100000:1.0:1788793122.281890:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199232 00000100:00100000:2.0:1788793122.282021:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788793122.282030:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000358f440d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5863:x1875685461199232:12345-0@lo:502: 00000100:00100000:2.0:1788793122.282773:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000358f440d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5863:x1875685461199232:12345-0@lo:502: Request processed in 742us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.282781:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788793122.282919:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba917ed8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5863:1875685461199232:0@lo:502: 00000020:01000004:0.0:1788793122.282986:0:5863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788793122.283000:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000ef4de24) 00000020:00000080:0.0:1788793122.283018:0:5863:0:(obd_config.c:716:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788793122.283457:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000071508f31 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788793122.283462:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000071508f31 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788793122.283464:0:5863:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000071508f31 4 00010000:00080000:0.0:1788793122.283490:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c949130c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:0.0:1788793122.287568:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788793122.287909:0:5863:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788793122.287943:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788793122.287955:0:5863:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa112893a8a83cc5a 00000100:00080000:0.0:1788793122.287966:0:5863:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788793122.287976:0:5863:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c949130c using connection 192.168.201.106@tcp/0@lo 00000100:00100000:0.0:1788793122.288020:0:5863:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007bd4ae0b x1875685461199360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788793122.288045:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788793122.288500:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bd4ae0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875685461199360:0@lo:38: 00000100:00100000:3.0:1788793122.288576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793122.288693:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199360 00000100:00100000:0.0:1788793122.288702:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199360 00000100:00100000:0.0:1788793122.288731:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793122.288737:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000084737f96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875685461199360:12345-0@lo:38: 00000100:00100000:0.0:1788793122.288819:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000084737f96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875685461199360:12345-0@lo:38: Request processed in 81us (243us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788793122.288827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793122.288920:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788793122.288927:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000c949130c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788793122.288931:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788793122.288934:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bd4ae0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875685461199360:0@lo:38: 00000100:00100000:3.0:1788793122.289960:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5863:1875685461199488:0@lo:502: 00000100:00100000:3.0:1788793122.290018:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793122.290183:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 00000000911789ef going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.293621:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199488 00000100:00100000:2.0:1788793122.293636:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199488 00000100:00100000:2.0:1788793122.293733:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788793122.293743:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ecebcd6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5863:x1875685461199488:12345-0@lo:502: 00000100:00100000:2.0:1788793122.294023:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ecebcd6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5863:x1875685461199488:12345-0@lo:502: Request processed in 282us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.294031:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788793122.294193:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5863:1875685461199488:0@lo:502: 00000040:00080000:3.0:1788793122.294242:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788793122.296895:0:5815:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788793122.296925:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793122.296945:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793122.296957:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 0000000013896757/0xa112893a8a83cc45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788793122.297007:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788793122.297014:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788793122.297015:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793122.297016:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793122.297017:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793122.297019:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793122.297020:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788793122.297021:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788793122.297022:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793122.297022:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793122.297024:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793122.297025:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793122.297028:0:5815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788793122.297030:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788793122.297031:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788793122.297032:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793122.297032:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793122.297033:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793122.297034:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793122.297035:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788793122.297036:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788793122.297037:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793122.297038:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793122.297038:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793122.297039:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793122.297130:0:5815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788793122.299001:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461199616:0@lo:253: 00000100:00100000:1.0:1788793122.299718:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793122.299773:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d248aa3d going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.299854:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199616 00000100:00100000:2.0:1788793122.299864:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199616 00000100:00100000:2.0:1788793122.299919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788793122.299926:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0a17f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5815:x1875685461199616:12345-0@lo:253: 20000000:01000000:2.0:1788793122.299955:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788793122.299968:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788793122.343882:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788793122.343902:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788793122.343995:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788793122.344000:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788793122.344025:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344044:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344060:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344100:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344115:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 12 pid: 5828 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793122.344128:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461199744:0@lo:104: 00000100:00100000:0.0:1788793122.344237:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793122.344288:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cb734d8 going to sleep for 11 seconds 00000100:00100000:2.0:1788793122.344590:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199744 00000100:00100000:2.0:1788793122.344612:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199744 00000100:00100000:2.0:1788793122.344664:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788793122.344673:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e5ae9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461199744:12345-0@lo:104: 00010000:00010000:2.0:1788793122.344695:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793122.344750:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788793122.344756:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e5ae9d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461199744:12345-0@lo:104: Request processed in 84us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.344762:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788793122.344898:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793122.344904:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344912:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ade01f16 already unused, calling callback (00000000a6e1ec52) 10000000:00010000:0.0:1788793122.344915:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344938:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793122.344944:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793122.344949:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793122.344988:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.344995:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793122.345013:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345019:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc30 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345037:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793122.345038:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793122.345040:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793122.345101:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092f3b617 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461199872:0@lo:103: 00000100:00100000:0.0:1788793122.345131:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793122.345457:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461199872 00000100:00100000:0.0:1788793122.345462:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461199872 00010000:00010000:0.0:1788793122.345481:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 13 pid: 5828 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793122.345503:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793122.345509:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089ba1016 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461199872:12345-0@lo:103: 00010000:00010000:0.0:1788793122.345525:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793122.345529:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 13 pid: 5828 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345538:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 13 pid: 5828 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345551:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345559:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788793122.345573:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001573684s 00010000:00010000:0.0:1788793122.345576:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345583:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345588:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345662:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345667:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002402c7b1 already unused, calling callback (000000009654bdcb) 00010000:00010000:0.0:1788793122.345671:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345687:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345702:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345711:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793122.345741:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089ba1016 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461199872:12345-0@lo:103: Request processed in 232us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793122.345747:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793122.345794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092f3b617 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461199872:0@lo:103: 00010000:00010000:0.0:1788793122.345819:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005dd18b7e/0xa112893a8a83cc30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cc29 expref: 12 pid: 5828 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793122.345829:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461199744:0@lo:104: 00010000:00010000:0.0:1788793122.345838:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345845:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345849:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793122.345854:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002402c7b1/0xa112893a8a83cc61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793122.354900:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0a17f8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5815:x1875685461199616:12345-0@lo:253: Request processed in 54967us (55177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793122.354915:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788793122.355009:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5815:1875685461199616:0@lo:253: 10000000:01000000:1.0:1788793122.355025:0:5815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788793122.355028:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788793122.355030:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788793122.355031:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793122.355032:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793122.355034:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793122.355035:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793122.355036:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788793122.355038:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788793122.355113:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793122.355115:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793122.355116:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793122.355117:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788793122.355134:0:5815:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788793122.365993:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.366915:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788793122.367720:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.367914:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788793122.368181:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.368759:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788793122.369571:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.369796:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788793122.369989:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.370228:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788793122.370410:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788793122.370611:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788793122.413455:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788793122.433131:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788793122.433163:0:5868:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788793122.433170:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788793122.433977:0:5869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788793122.437104:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788793122.437549:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788793122.438132:0:5815:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788793122.438469:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788793122.438758:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788793122.440867:0:5815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788793122.441442:0:5815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788793122.441469:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788793122.441784:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788793122.442099:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788793122.444794:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788793122.445524:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788793122.445734:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788793122.446119:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788793122.446551:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788793122.446727:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788793122.447031:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788793122.447191:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788793122.447518:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788793122.447657:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788793122.447897:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788793122.448173:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788793122.448571:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788793122.448789:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788793122.449019:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788793122.449222:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788793122.450127:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788793122.450656:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788793122.450828:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788793122.450974:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788793122.451123:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788793122.451374:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788793122.451525:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788793122.451662:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00010000:00010000:0.0:1788793122.451709:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788793122.451812:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788793122.451957:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788793122.452115:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788793122.452584:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788793122.452751:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788793122.453581:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788793122.453758:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788793122.453894:0:5815:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788793122.454088:0:5815:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788793122.482906:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788793122.527526:0:5815:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788793122.527557:0:5815:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc3301c1b988 00100000:10000000:3.0:1788793122.527565:0:5815:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788793122.528838:0:5815:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788793122.528854:0:5815:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788793122.528874:0:5815:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788793122.528891:0:5815:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788793122.567548:0:5869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788793122.567634:0:5869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788793122.567639:0:5869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788793123.473397:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793124.502206:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793125.520932:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793126.546275:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788793127.120541:0:6111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788793127.568504:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788793127.702229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788793127.702238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788793127.702241:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c949130c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788793127.702403:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461200000:0@lo:400: 00000100:00100000:2.0:1788793127.702474:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793127.702592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200000 00000100:00100000:2.0:1788793127.702599:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200000 00000100:00100000:2.0:1788793127.702645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793127.702654:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056c3f3a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3310:x1875685461200000:12345-0@lo:400: 00000100:00100000:2.0:1788793127.702703:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056c3f3a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3310:x1875685461200000:12345-0@lo:400: Request processed in 50us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793127.702711:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793127.702759:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009025a10b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461200000:0@lo:400: 00000100:00080000:1.0:1788793127.702912:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c949130c using connection 192.168.201.106@tcp/0@lo 00000100:00100000:1.0:1788793127.702935:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003d818b53 x1875685461200128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788793127.703022:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d818b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875685461200128:0@lo:38: 00000100:00100000:2.0:1788793127.703057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793127.703132:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200128 00000100:00100000:0.0:1788793127.703157:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200128 00000100:00100000:0.0:1788793127.703185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793127.703190:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000971da744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875685461200128:12345-0@lo:38: 00010000:00080000:0.0:1788793127.703212:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:0.0:1788793127.703266:0:5837:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa112893a8a83cc68 00000004:00100000:0.0:1788793127.703328:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788793127.703440:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000c3e14ce2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788793127.703482:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000971da744 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875685461200128:12345-0@lo:38: Request processed in 291us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793127.703489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788793127.703764:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003d818b53 x1875685461200128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788793127.703779:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788793127.703786:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788793127.703792:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788793127.703794:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000c949130c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788793127.703799:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d818b53 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875685461200128:0@lo:38: 00010000:00010000:3.0:1788793128.594389:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793129.619463:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788793129.744426:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788793129.744435:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926488cd7800 from 3 10000000:01000000:2.0:1788793129.744440:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788793129.744486:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793129.744499:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793129.744510:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793129.744535:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b29bc91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461200256:0@lo:101: 00000100:00100000:2.0:1788793129.744619:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793129.744695:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000002be0a16a going to sleep for 11 seconds 00000100:00100000:0.0:1788793129.745085:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200256 00000100:00100000:0.0:1788793129.745107:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200256 00000100:00100000:0.0:1788793129.745208:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788793129.745216:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f43eca69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5832:x1875685461200256:12345-0@lo:101: 00010000:00010000:0.0:1788793129.745229:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793129.745245:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9fba2f0/0xa112893a8a83cc76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cc6f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793129.745269:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9fba2f0/0xa112893a8a83cc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793129.745280:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9fba2f0/0xa112893a8a83cc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793129.745288:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9fba2f0, rc 0) 00000100:00100000:0.0:1788793129.745342:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f43eca69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461200256:12345-0@lo:101: Request processed in 127us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793129.745348:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788793129.745538:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b29bc91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461200256:0@lo:101: 00010000:00010000:3.0:1788793129.745564:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793129.745574:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793129.745638:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461200384:0@lo:256: 00000100:00100000:3.0:1788793129.745674:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793129.745707:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba7ad28c going to sleep for 11 seconds 00000100:00100000:2.0:1788793129.745765:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200384 00000100:00100000:2.0:1788793129.745775:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200384 00000100:00100000:2.0:1788793129.745812:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793129.745818:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000565234c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461200384:12345-0@lo:256: 20000000:01000000:2.0:1788793129.745832:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788793129.745848:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788793129.745851:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788793129.745948:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000565234c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461200384:12345-0@lo:256: Request processed in 131us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793129.745955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788793129.746389:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461200384:0@lo:256: 10000000:01000000:3.0:1788793129.746434:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788793129.746441:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793129.746449:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: 00000000ade01f16/0xa112893a8a83cc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793130.643702:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793131.671712:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788793132.661880:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff25193c0 20000000:00000080:0.0:1788793132.661900:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9264ba036000 uarg=0000000000000000 20000000:01000000:0.0:1788793132.662017:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788793132.662024:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788793132.662029:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788793132.662394:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788793132.662408:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788793132.669810:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788793132.670120:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788793132.670224:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788793132.670272:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788793132.670293:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788793132.670311:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793132.670330:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793132.670336:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793132.670373:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793132.670385:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793132.670398:0:6313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d818b53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875685461200512:0@lo:104: 00000100:00100000:1.0:1788793132.670475:0:6313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793132.670545:0:6313:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb03ce6d going to sleep for 11 seconds 00000100:00100000:0.0:1788793132.670822:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200512 00000100:00100000:0.0:1788793132.670831:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200512 00000100:00100000:0.0:1788793132.670871:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793132.670878:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016026b8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:6313:x1875685461200512:12345-0@lo:104: 00010000:00010000:0.0:1788793132.670891:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.670968:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793132.670974:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016026b8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:6313:x1875685461200512:12345-0@lo:104: Request processed in 97us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793132.670981:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788793132.671003:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793132.671008:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671015:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2513640 already unused, calling callback (00000000a6e1ec52) 10000000:00010000:0.0:1788793132.671018:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671026:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793132.671033:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793132.671039:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788793132.671067:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671074:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793132.671089:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671095:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: 00000000e2513640/0xa112893a8a83cc37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc3e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671124:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793132.671126:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793132.671128:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793132.671166:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461200640:0@lo:103: 00000100:00100000:0.0:1788793132.671197:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793132.671234:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200640 00000100:00100000:0.0:1788793132.671238:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200640 00010000:00010000:0.0:1788793132.671254:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793132.671277:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793132.671283:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092f3b617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3311:x1875685461200640:12345-0@lo:103: 00010000:00010000:0.0:1788793132.671293:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793132.671297:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671307:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671321:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671329:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671342:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671348:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671359:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671364:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671368:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009921839a already unused, calling callback (000000009654bdcb) 00010000:00010000:0.0:1788793132.671371:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671377:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671385:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.671395:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793132.671424:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092f3b617 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3311:x1875685461200640:12345-0@lo:103: Request processed in 143us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793132.671431:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793132.671477:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461200640:0@lo:103: 00010000:00010000:2.0:1788793132.671594:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000055fb6525/0xa112893a8a83cc3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cc37 expref: 11 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793132.671605:0:6313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d818b53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875685461200512:0@lo:104: 00010000:00010000:2.0:1788793132.671618:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793132.671626:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793132.671631:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793132.671636:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009921839a/0xa112893a8a83cc7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793132.691587:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793132.818743:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7ca5a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461200896:0@lo:400: 00000100:00100000:3.0:1788793132.818812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793132.818919:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793132.818925:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461200768:0@lo:400: 00000100:00100000:3.0:1788793132.818956:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793132.818998:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200896 00000100:00100000:3.0:1788793132.819006:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200896 00000100:00100000:3.0:1788793132.819050:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793132.819058:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006d62a0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461200896:12345-0@lo:400: 00000100:00100000:3.0:1788793132.819108:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006d62a0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461200896:12345-0@lo:400: Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793132.819114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793132.819136:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461200768 00000100:00100000:3.0:1788793132.819313:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461200768 00000100:00100000:3.0:1788793132.819343:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788793132.819349:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000814c8832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3309:x1875685461200768:12345-0@lo:400: 00000100:00100000:3.0:1788793132.819380:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000814c8832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3309:x1875685461200768:12345-0@lo:400: Request processed in 33us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793132.819387:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788793132.819427:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c014d78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461200768:0@lo:400: 00010000:00080000:3.0:1788793132.819439:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f7ca5a58 x1875685461200896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793132.819464:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7ca5a58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461200896:0@lo:400: 00010000:00010000:1.0:1788793133.714636:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793134.740055:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793135.760373:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793136.784265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793137.810970:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793137.944393:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d3ebbe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875685461201152:0@lo:400: 00000100:00100000:0.0:1788793137.944481:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793137.944533:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788793137.944539:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461201024:0@lo:400: 00000100:00100000:0.0:1788793137.944566:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793137.944610:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201024 00000100:00100000:0.0:1788793137.944618:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201024 00000100:00100000:0.0:1788793137.944666:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793137.944674:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b3782bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3311:x1875685461201024:12345-0@lo:400: 00000100:00100000:0.0:1788793137.944723:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b3782bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3311:x1875685461201024:12345-0@lo:400: Request processed in 49us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793137.944730:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793137.944772:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461201024:0@lo:400: 00000100:00100000:2.0:1788793137.945084:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201152 00000100:00100000:2.0:1788793137.945089:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201152 00000100:00100000:2.0:1788793137.945127:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793137.945134:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eed0eb78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875685461201152:12345-0@lo:400: 00000100:00100000:2.0:1788793137.945298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eed0eb78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875685461201152:12345-0@lo:400: Request processed in 165us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793137.945312:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788793137.945366:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d3ebbe8d x1875685461201152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793137.945378:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d3ebbe8d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875685461201152:0@lo:400: 00010000:00010000:3.0:1788793138.841220:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793139.857428:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788793139.986825:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788793139.986834:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926488cd7800 from 1 10000000:01000000:0.0:1788793139.986838:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788793139.986880:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: 000000002148bd41/0xa112893a8a83cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793139.986893:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: 000000002148bd41/0xa112893a8a83cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793139.986904:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: 000000002148bd41/0xa112893a8a83cc84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793139.986926:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201280:0@lo:101: 00000100:00100000:0.0:1788793139.986999:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793139.987060:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072b1820b going to sleep for 11 seconds 00000100:00100000:3.0:1788793139.987081:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201280 00000100:00100000:3.0:1788793139.987091:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201280 00000100:00100000:3.0:1788793139.987168:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788793139.987177:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec6bcb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:5832:x1875685461201280:12345-0@lo:101: 00010000:00010000:3.0:1788793139.987191:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793139.987205:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026a4d6fb/0xa112893a8a83cc8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cc84 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793139.987229:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026a4d6fb/0xa112893a8a83cc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793139.987240:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026a4d6fb/0xa112893a8a83cc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793139.987249:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026a4d6fb, rc 0) 00000100:00100000:3.0:1788793139.987294:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec6bcb37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461201280:12345-0@lo:101: Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793139.987312:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788793139.987446:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201280:0@lo:101: 00010000:00010000:0.0:1788793139.987461:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: 000000002148bd41/0xa112893a8a83cc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793139.987470:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: 000000002148bd41/0xa112893a8a83cc84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793139.987536:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201408:0@lo:501: 00000100:00100000:0.0:1788793139.987574:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793139.987599:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072b1820b going to sleep for 11 seconds 00000100:00100000:3.0:1788793139.987657:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201408 00000100:00100000:3.0:1788793139.987662:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201408 00000100:00100000:3.0:1788793139.987733:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788793139.987742:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073b5d198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461201408:12345-0@lo:501: 00000100:00100000:3.0:1788793139.988030:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073b5d198 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461201408:12345-0@lo:501: Request processed in 290us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793139.988037:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788793139.988781:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201408:0@lo:501: 00000100:00100000:0.0:1788793139.988930:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201536:0@lo:503: 00000100:00100000:0.0:1788793139.988978:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793139.989995:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072b1820b going to sleep for 11 seconds 00000100:00100000:3.0:1788793139.992537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201536 00000100:00100000:3.0:1788793139.992561:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201536 00000100:00100000:3.0:1788793139.992629:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788793139.992638:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031b4f659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461201536:12345-0@lo:503: 00000100:00100000:3.0:1788793139.993408:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031b4f659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461201536:12345-0@lo:503: Request processed in 768us (4427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793139.993419:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788793139.996904:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab8a213b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461201536:0@lo:503: 00000100:00100000:2.0:1788793139.997505:0:6650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f9739f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6650:1875685461201664:0@lo:502: 00000100:00100000:2.0:1788793139.997577:0:6650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793139.997969:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201664 00000100:00100000:0.0:1788793139.997976:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201664 00000100:00100000:0.0:1788793139.998024:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788793139.998033:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000265eb8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6650:x1875685461201664:12345-0@lo:502: 00000100:00100000:0.0:1788793139.998289:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000265eb8e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6650:x1875685461201664:12345-0@lo:502: Request processed in 257us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793139.998296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788793139.998390:0:6650:0:(client.c:2716:ptlrpc_set_wait()) set 0000000000940e55 going to sleep for 11 seconds 00000100:00100000:2.0:1788793139.998407:0:6650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f9739f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6650:1875685461201664:0@lo:502: 00000020:01000000:2.0:1788793139.998432:0:6650:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793139.998442:0:6650:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793139.998444:0:6650:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788793139.998451:0:6650:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff926488cd7800 00000020:00000080:2.0:1788793139.998454:0:6650:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788793139.998493:0:6650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6650:1875685461201792:0@lo:502: 00000100:00100000:2.0:1788793139.998527:0:6650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793139.998550:0:6650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b1741d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788793139.999648:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201792 00000100:00100000:0.0:1788793139.999659:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201792 00000100:00100000:0.0:1788793139.999705:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788793139.999714:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6650:x1875685461201792:12345-0@lo:502: 00000100:00100000:0.0:1788793139.999897:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6650:x1875685461201792:12345-0@lo:502: Request processed in 184us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793139.999904:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788793140.000172:0:6650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6650:1875685461201792:0@lo:502: 00000020:01000000:2.0:1788793140.000202:0:6650:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793140.000207:0:6650:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793140.000209:0:6650:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788793140.000213:0:6650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788793140.000496:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788793140.000512:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788793140.000527:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793140.000538:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793140.882468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788793141.156632:0:6683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788793141.156635:0:6683:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788793141.156973:0:6683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9264b9db6800 00000020:01000004:1.0:1788793141.157120:0:6683:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788793141.157161:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788793141.157185:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9264947d33d0) 00000020:00000080:1.0:1788793141.157205:0:6683:0:(obd_config.c:716:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788793141.175285:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788793141.177235:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788793141.257328:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788793141.279858:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788793141.279887:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788793141.279952:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788793141.279989:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788793141.280377:0:6683:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788793141.280387:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788793141.280397:0:6683:0:(genops.c:1375:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa112893a8a83cc99 00000020:01000004:0.0:1788793141.280404:0:6683:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788793141.280423:0:6683:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788793141.280426:0:6683:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788793141.280431:0:6683:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788793141.280436:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788793141.280446:0:6683:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92648853cdb8) 00000020:00000080:0.0:1788793141.280455:0:6683:0:(obd_config.c:716:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788793141.290716:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793141.291186:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788793141.291192:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788793141.302816:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788793141.302839:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788793141.303469:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788793141.303476:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788793141.309422:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788793141.309595:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788793141.309602:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788793141.316227:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788793141.316249:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788793141.351115:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788793141.351414:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788793141.351422:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788793141.353895:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788793141.353908:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788793141.355233:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788793141.355252:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788793141.360842:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788793141.361242:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788793141.361248:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788793141.362452:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788793141.362529:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788793141.469665:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788793141.470288:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788793141.470296:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788793141.472475:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788793141.472489:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788793141.473462:0:6683:0:(obd_config.c:813:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788793141.473486:0:6683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788793141.473492:0:6683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788793141.502712:0:6683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788793141.502813:0:6683:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.106@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788793141.502818:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788793141.502820:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788793141.502821:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793141.502822:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793141.502824:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793141.502825:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793141.502826:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793141.502828:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793141.502829:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793141.502830:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793141.502832:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788793141.502835:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788793141.502838:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788793141.502839:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788793141.502840:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793141.502841:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788793141.502842:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793141.502843:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793141.502844:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793141.502845:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788793141.502846:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788793141.502847:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793141.502848:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788793141.502872:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788793141.502887:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461201920:0@lo:253: 00000100:00100000:0.0:1788793141.502948:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793141.503066:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf1c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788793141.503421:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461201920 00000100:00100000:2.0:1788793141.503435:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461201920 00000100:00100000:2.0:1788793141.503508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793141.503525:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461201920:12345-0@lo:253: 20000000:01000000:2.0:1788793141.503553:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788793141.503556:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788793141.503561:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788793141.503565:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788793141.504915:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793141.505414:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788793141.505435:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788793141.505477:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788793141.505486:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788793141.505513:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788793141.505672:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788793141.506862:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788793141.506888:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:2.0:1788793141.506890:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788793141.506926:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788793141.506933:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788793141.507286:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788793141.507297:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:2.0:1788793141.507336:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788793141.507356:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788793141.507386:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788793141.507429:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788793141.509287:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788793141.509319:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:2.0:1788793141.509321:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:2.0:1788793141.509377:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788793141.509385:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788793141.509418:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788793141.509436:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:2.0:1788793141.509487:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788793141.509498:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788793141.509668:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788793141.509703:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788793141.509802:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788793141.509806:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788793141.509810:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788793141.509823:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788793141.509826:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788793141.510419:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788793141.510423:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788793141.511473:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788793141.511559:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788793141.511614:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788793141.511906:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788793141.511948:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788793141.512018:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788793141.512042:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788793141.512045:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788793141.513425:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788793141.513491:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788793141.513615:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788793141.514262:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788793141.514310:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788793141.514338:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788793141.514361:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788793141.514364:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788793141.514925:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788793141.515478:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788793141.515554:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788793141.515620:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788793141.515635:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788793141.515637:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788793141.515647:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788793141.515667:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515690:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515698:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515704:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515712:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515891:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.515906:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.515922:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202048:0@lo:104: 00000100:00100000:3.0:1788793141.515986:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788793141.516179:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.516187:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.516196:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202176:0@lo:104: 00000100:00100000:3.0:1788793141.516218:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793141.516568:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.516577:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.516586:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202304:0@lo:104: 00000100:00100000:2.0:1788793141.516609:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793141.516656:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202048 00000100:00100000:1.0:1788793141.516663:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202048 00000100:00100000:1.0:1788793141.516697:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202176 00000100:00100000:1.0:1788793141.516699:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202176 00000100:00100000:1.0:1788793141.516711:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.516727:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:5829:x1875685461202048:12345-0@lo:104: 00010000:00010000:1.0:1788793141.516740:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.516795:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793141.516808:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:5829:x1875685461202048:12345-0@lo:104: Request processed in 90us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.516816:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.516833:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788793141.516839:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5829:x1875685461202176:12345-0@lo:104: 00010000:00010000:1.0:1788793141.516847:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.516880:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788793141.516885:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5829:x1875685461202176:12345-0@lo:104: Request processed in 47us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.516891:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788793141.516908:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788793141.516913:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.516921:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481504e00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1788793141.516925:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.516933:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793141.516941:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793141.516946:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793141.516972:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.516987:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793141.517016:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.517024:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481504e00/0xa112893a8a83cc45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc4c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517281:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793141.517461:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793141.517467:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517474:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926482a10a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793141.517477:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517484:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793141.517490:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793141.517495:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793141.517523:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517530:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793141.517537:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517542:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cbd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbdc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.517556:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793141.517557:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793141.517559:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793141.517564:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793141.517566:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793141.517677:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793141.517679:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793141.517680:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793141.517702:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461202432:0@lo:103: 00000100:00100000:1.0:1788793141.517749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793141.517778:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788793141.517784:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461202560:0@lo:103: 00000100:00100000:1.0:1788793141.517804:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793141.517835:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202432 00000100:00100000:1.0:1788793141.517841:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202432 00010000:00010000:1.0:1788793141.517863:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 13 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793141.517885:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202560 00000100:00100000:1.0:1788793141.517887:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202560 00010000:00010000:1.0:1788793141.517898:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793141.517910:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.517917:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3308:x1875685461202432:12345-0@lo:103: 00010000:00010000:1.0:1788793141.517929:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793141.517940:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.517950:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 14 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.517965:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793141.518008:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3308:x1875685461202432:12345-0@lo:103: Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.518015:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.518231:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788793141.518242:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3308:x1875685461202560:12345-0@lo:103: 00010000:00010000:1.0:1788793141.518249:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793141.518254:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 13 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.518262:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 13 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.518272:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793141.518296:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3308:x1875685461202560:12345-0@lo:103: Request processed in 57us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.518302:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788793141.518337:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461202560:0@lo:103: 00000100:00100000:1.0:1788793141.518358:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461202432:0@lo:103: 00000100:00100000:2.0:1788793141.518501:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264a1330540 going to sleep for 11 seconds 00010000:00010000:2.0:1788793141.518595:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481504c00/0xa112893a8a83cc4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cc45 expref: 12 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.518617:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202048:0@lo:104: 00010000:00010000:2.0:1788793141.518632:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505800/0xa112893a8a83cbdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cbd5 expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.518642:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202176:0@lo:104: 00000100:00100000:1.0:1788793141.518685:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202304 00000100:00100000:1.0:1788793141.518691:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202304 00000100:00100000:1.0:1788793141.518709:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793141.518715:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5829:x1875685461202304:12345-0@lo:104: 00010000:00010000:1.0:1788793141.518792:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.518896:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875685461202304:0@lo:104: 00010000:00010000:2.0:1788793141.518916:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.518944:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793141.518952:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5829:x1875685461202304:12345-0@lo:104: Request processed in 236us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.518958:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788793141.521921:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793141.521950:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.521964:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481637c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793141.521968:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.521978:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793141.521986:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793141.522002:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793141.522193:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522202:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793141.522219:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522226:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83cbb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cbc0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522251:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793141.522252:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793141.522254:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793141.522417:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461202688:0@lo:103: 00000100:00100000:1.0:1788793141.522486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.522663:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202688 00000100:00100000:2.0:1788793141.522671:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202688 00010000:00010000:2.0:1788793141.522702:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.522752:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788793141.522771:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:3310:x1875685461202688:12345-0@lo:103: 00010000:00010000:2.0:1788793141.522784:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793141.522791:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522803:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522817:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505600/0xa112893a8a83cbc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cbb9 expref: 11 pid: 5828 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522832:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522841:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522856:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522863:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522870:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522876:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522882:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481505000 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:2.0:1788793141.522886:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522899:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522913:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522922:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793141.522957:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:3310:x1875685461202688:12345-0@lo:103: Request processed in 189us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793141.522964:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788793141.522987:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.522995:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.523001:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505000/0xa112893a8a83cca7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788793141.523011:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788793141.523861:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461202688:0@lo:103: 00000100:00100000:2.0:1788793141.577642:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:6683:x1875685461201920:12345-0@lo:253: Request processed in 74117us (74684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793141.577658:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788793141.577878:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461201920:0@lo:253: 10000000:01000000:0.0:1788793141.577893:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788793141.577896:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788793141.577898:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788793141.577900:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793141.577901:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788793141.577902:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793141.577903:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793141.577918:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793141.577919:0:6683:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788793141.577921:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793141.577923:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788793141.578006:0:6683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9264b9db6800 from lustre-OST0000 10000000:01000000:0.0:1788793141.578116:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788793141.578120:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788793141.578127:0:6683:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff926488538000 local copy 10000000:01000000:0.0:1788793141.578130:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788793141.578197:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.578210:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.578219:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793141.578237:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461202816:0@lo:101: 00000100:00100000:0.0:1788793141.578277:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793141.578386:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf1c0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.578532:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202816 00000100:00100000:1.0:1788793141.578539:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202816 00000100:00100000:1.0:1788793141.578888:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788793141.578899:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:6683:x1875685461202816:12345-0@lo:101: 00010000:00010000:1.0:1788793141.578913:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793141.578984:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a11600/0xa112893a8a83ccb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ccae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.579019:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a11600/0xa112893a8a83ccb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ccae expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.579169:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a11600/0xa112893a8a83ccb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccae expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.579180:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a11600, rc 0) 00000100:00100000:1.0:1788793141.579238:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:6683:x1875685461202816:12345-0@lo:101: Request processed in 341us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.579244:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788793141.579373:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461202816:0@lo:101: 00010000:00010000:3.0:1788793141.579389:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.579397:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.579500:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461202944:0@lo:501: 00000100:00100000:3.0:1788793141.579542:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793141.579783:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461202944 00000100:00100000:0.0:1788793141.579789:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461202944 00000100:00100000:0.0:1788793141.579813:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788793141.579819:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:6683:x1875685461202944:12345-0@lo:501: 00000100:00100000:0.0:1788793141.580242:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:6683:x1875685461202944:12345-0@lo:501: Request processed in 209us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793141.580251:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788793141.580404:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155480 going to sleep for 11 seconds 00000100:00100000:3.0:1788793141.580420:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461202944:0@lo:501: 10000000:01000000:3.0:1788793141.580435:0:6683:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788793141.580465:0:6683:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788793141.580471:0:6683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.580486:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.580493:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.580509:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788793141.580605:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793141.580610:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.580628:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f5600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1788793141.580631:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.580639:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793141.580645:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793141.580650:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788793141.580669:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.580674:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788793141.580700:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.580706:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9264880f5600/0xa112893a8a83ccae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83ccb5 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.580729:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793141.580730:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793141.580732:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793141.580836:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461203072:0@lo:103: 00000100:00100000:2.0:1788793141.580875:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793141.580955:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203072 00000100:00100000:0.0:1788793141.580961:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203072 00000100:00100000:2.0:1788793141.581133:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788793141.581162:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:3311:x1875685461203072:12345-0@lo:103: 00010000:00010000:2.0:1788793141.581175:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793141.581197:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926482a11600/0xa112893a8a83ccb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa112893a8a83ccae expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.581211:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793141.581244:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:3311:x1875685461203072:12345-0@lo:103: Request processed in 103us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793141.581250:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788793141.581278:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461203072:0@lo:103: 10000000:01000000:3.0:1788793141.581431:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9264b9db6800 10000000:01000000:3.0:1788793141.581437:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788793141.581443:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff926488538000 10000000:01000000:3.0:1788793141.581446:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788793141.581449:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff926488538000 from 1 10000000:01000000:3.0:1788793141.581452:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788793141.581476:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.581484:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.581493:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.581507:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203200:0@lo:101: 00000100:00100000:3.0:1788793141.583371:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.583411:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.583477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203200 00000100:00100000:0.0:1788793141.583485:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203200 00000100:00100000:0.0:1788793141.583538:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788793141.583548:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+9:6683:x1875685461203200:12345-0@lo:101: 00010000:00010000:0.0:1788793141.583575:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793141.583592:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4e00/0xa112893a8a83ccc3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ccbc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.583617:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4e00/0xa112893a8a83ccc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ccbc expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.583627:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4e00/0xa112893a8a83ccc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccbc expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.583636:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4e00, rc 0) 00000100:00100000:0.0:1788793141.583682:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:6683:x1875685461203200:12345-0@lo:101: Request processed in 136us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.583688:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788793141.583914:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203200:0@lo:101: 00010000:00010000:3.0:1788793141.583930:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccc3 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.583954:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ccc3 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793141.583986:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788793141.584011:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccc3 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.584019:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481505400/0xa112893a8a83ccbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccc3 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793141.584025:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788793141.584269:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788793141.584277:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788793141.584280:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793141.584307:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.584316:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.584324:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.584354:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203328:0@lo:101: 00000100:00100000:3.0:1788793141.584389:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.584417:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.584569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203328 00000100:00100000:0.0:1788793141.584576:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203328 00000100:00100000:0.0:1788793141.584737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788793141.584746:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+10:6683:x1875685461203328:12345-0@lo:101: 00010000:00010000:0.0:1788793141.584755:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793141.584765:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ccca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.584780:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ccca expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.584789:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccca expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.584795:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4200, rc 0) 00000100:00100000:0.0:1788793141.584847:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203328:12345-0@lo:101: Request processed in 102us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.584854:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788793141.584928:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203328:0@lo:101: 00010000:00010000:3.0:1788793141.584939:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.584952:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.585083:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203456:0@lo:501: 00000100:00100000:3.0:1788793141.585107:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.585544:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.585662:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203456 00000100:00100000:1.0:1788793141.585668:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203456 00000100:00100000:1.0:1788793141.585694:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788793141.585700:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203456:12345-0@lo:501: 00000100:00100000:1.0:1788793141.585941:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203456:12345-0@lo:501: Request processed in 239us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.585948:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788793141.586236:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203456:0@lo:501: 00000100:00100000:3.0:1788793141.586270:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203584:0@lo:503: 00000100:00100000:3.0:1788793141.586310:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.586332:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.586424:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203584 00000100:00100000:1.0:1788793141.586430:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203584 00000100:00100000:1.0:1788793141.586450:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788793141.586457:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203584:12345-0@lo:503: 00000100:00100000:1.0:1788793141.586802:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203584:12345-0@lo:503: Request processed in 344us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.586809:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788793141.586886:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203584:0@lo:503: 00000040:00080000:3.0:1788793141.587368:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788793141.587441:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203712:0@lo:502: 00000100:00100000:3.0:1788793141.587479:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.587499:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.587643:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203712 00000100:00100000:0.0:1788793141.587649:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203712 00000100:00100000:0.0:1788793141.587677:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788793141.587683:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203712:12345-0@lo:502: 00000100:00100000:0.0:1788793141.588593:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203712:12345-0@lo:502: Request processed in 905us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.588603:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788793141.588813:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203712:0@lo:502: 00000040:00080000:3.0:1788793141.589296:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788793141.589365:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788793141.589395:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788793141.589436:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788793141.589467:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788793141.589497:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788793141.589669:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203840:0@lo:502: 00000100:00100000:3.0:1788793141.589792:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.589825:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.589894:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203840 00000100:00100000:0.0:1788793141.589901:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203840 00000100:00100000:0.0:1788793141.589943:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788793141.589951:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203840:12345-0@lo:502: 00000100:00100000:0.0:1788793141.590491:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203840:12345-0@lo:502: Request processed in 540us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.590498:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788793141.590661:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203840:0@lo:502: 00000040:00080000:3.0:1788793141.590867:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788793141.590880:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788793141.591854:0:6703:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788793141.591864:0:6703:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788793141.591870:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793141.591873:0:6703:0:(obd_config.c:1547:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788793141.591879:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788793141.593452:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9264bf4019e8) 00000020:00000080:0.0:1788793141.593490:0:6703:0:(obd_config.c:716:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788793141.593502:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788793141.593648:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9264b9db6800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788793141.593656:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788793141.593663:0:6703:0:(genops.c:1375:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa112893a8a83ccdf 00010000:00010000:0.0:1788793141.600783:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788793141.601785:0:6703:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788793141.606266:0:6703:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788793141.607245:0:6703:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788793141.617449:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788793141.618775:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788793141.621673:0:6703:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788793141.621686:0:6703:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793141.621692:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793141.621695:0:6703:0:(obd_config.c:1547:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788793141.621700:0:6703:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793141.621704:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793141.621705:0:6703:0:(obd_config.c:1547:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788793141.621709:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793141.621710:0:6703:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788793141.622023:0:6703:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793141.622028:0:6703:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793141.622236:0:6703:0:(obd_config.c:1547:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788793141.622241:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788793141.629213:0:6683:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788793141.629290:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788793141.629314:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.629329:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793141.629349:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9264b9db6800 from 1 10000000:01000000:3.0:1788793141.629352:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793141.629393:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.629403:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.629414:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793141.629437:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203968:0@lo:101: 00000100:00100000:3.0:1788793141.629503:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.630577:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.635656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461203968 00000100:00100000:0.0:1788793141.635673:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461203968 00000100:00100000:0.0:1788793141.635912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788793141.635925:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:6683:x1875685461203968:12345-0@lo:101: 00010000:00010000:0.0:1788793141.635943:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793141.635963:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cce6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.636008:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.636019:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.636103:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5600, rc 0) 00000100:00100000:0.0:1788793141.636212:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461203968:12345-0@lo:101: Request processed in 289us (6708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.636219:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788793141.636314:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461203968:0@lo:101: 00010000:00010000:2.0:1788793141.636333:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.636354:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.636478:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204096:0@lo:501: 00000100:00100000:2.0:1788793141.636512:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.640564:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.640733:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204096 00000100:00100000:1.0:1788793141.640753:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204096 00000100:00100000:1.0:1788793141.640791:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788793141.640800:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204096:12345-0@lo:501: 00000100:00100000:1.0:1788793141.641384:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204096:12345-0@lo:501: Request processed in 582us (4869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.641392:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788793141.641478:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204096:0@lo:501: 00000100:00100000:2.0:1788793141.641532:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204224:0@lo:503: 00000100:00100000:2.0:1788793141.641573:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.641601:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.641701:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204224 00000100:00100000:1.0:1788793141.641706:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204224 00000100:00100000:1.0:1788793141.641735:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788793141.641741:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204224:12345-0@lo:503: 00000100:00100000:1.0:1788793141.641908:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204224:12345-0@lo:503: Request processed in 165us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.641914:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788793141.642231:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204224:0@lo:503: 00000040:00080000:2.0:1788793141.642509:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793141.642597:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204352:0@lo:502: 00000100:00100000:2.0:1788793141.642637:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.642664:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.642819:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204352 00000100:00100000:1.0:1788793141.642825:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204352 00000100:00100000:1.0:1788793141.642849:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788793141.642856:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204352:12345-0@lo:502: 00000100:00100000:1.0:1788793141.643025:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204352:12345-0@lo:502: Request processed in 169us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.643200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788793141.643467:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204352:0@lo:502: 00000040:00080000:2.0:1788793141.643746:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788793141.643831:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788793141.643860:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204480:0@lo:502: 00000100:00100000:2.0:1788793141.643904:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.643942:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.644562:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204480 00000100:00100000:1.0:1788793141.644570:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204480 00000100:00100000:1.0:1788793141.644599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788793141.644607:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204480:12345-0@lo:502: 00000100:00100000:1.0:1788793141.644804:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204480:12345-0@lo:502: Request processed in 196us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.644810:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788793141.645174:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204480:0@lo:502: 00000040:00080000:2.0:1788793141.645455:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788793141.645469:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788793141.646433:0:6707:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793141.646444:0:6707:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793141.646446:0:6707:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788793141.646452:0:6707:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9264b9db6800 00000020:00000080:0.0:1788793141.646455:0:6707:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788793141.646474:0:6707:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788793141.646477:0:6707:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793141.646478:0:6707:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788793141.646480:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788793141.646666:0:6683:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788793141.646686:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788793141.646710:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.646838:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793141.646874:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788793141.646877:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9264b9db6800 10000000:01000000:2.0:1788793141.646880:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9264b9db6800 10000000:01000000:2.0:1788793141.646884:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793141.646890:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9264b9db6800 from 1 10000000:01000000:2.0:1788793141.646893:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793141.646923:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.646931:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.646958:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.646988:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204608:0@lo:101: 00000100:00100000:2.0:1788793141.647426:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.647507:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793141.647655:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204608 00000100:00100000:3.0:1788793141.647663:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204608 00000100:00100000:1.0:1788793141.647731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788793141.647741:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461204608:12345-0@lo:101: 00010000:00010000:1.0:1788793141.647753:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793141.647765:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ccf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.647789:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.647799:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.647808:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a11e00, rc 0) 00000100:00100000:1.0:1788793141.647854:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204608:12345-0@lo:101: Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.647862:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788793141.648020:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204608:0@lo:101: 00010000:00010000:2.0:1788793141.648107:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793141.648116:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793141.648230:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204736:0@lo:501: 00000100:00100000:2.0:1788793141.648255:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.648275:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.648350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204736 00000100:00100000:0.0:1788793141.648365:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204736 00000100:00100000:0.0:1788793141.648397:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788793141.648404:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204736:12345-0@lo:501: 00000100:00100000:0.0:1788793141.648634:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204736:12345-0@lo:501: Request processed in 230us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.648642:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788793141.648839:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204736:0@lo:501: 00000100:00100000:2.0:1788793141.648868:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204864:0@lo:503: 00000100:00100000:2.0:1788793141.648905:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.648934:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.648984:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204864 00000100:00100000:0.0:1788793141.648990:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204864 00000100:00100000:0.0:1788793141.649009:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788793141.649015:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204864:12345-0@lo:503: 00000100:00100000:0.0:1788793141.649268:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204864:12345-0@lo:503: Request processed in 253us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.649275:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788793141.649635:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204864:0@lo:503: 00000040:00080000:2.0:1788793141.649900:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793141.649984:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204992:0@lo:502: 00000100:00100000:2.0:1788793141.650330:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.650371:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.650430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461204992 00000100:00100000:0.0:1788793141.650435:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461204992 00000100:00100000:0.0:1788793141.650471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788793141.650478:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204992:12345-0@lo:502: 00000100:00100000:0.0:1788793141.651309:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461204992:12345-0@lo:502: Request processed in 829us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.651318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788793141.651790:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461204992:0@lo:502: 00000040:00080000:2.0:1788793141.652385:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788793141.652446:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788793141.652480:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788793141.652678:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788793141.652732:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788793141.652779:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788793141.652827:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788793141.652861:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788793141.652907:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788793141.652939:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788793141.652969:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788793141.653122:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788793141.653199:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788793141.653236:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788793141.653300:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788793141.653357:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788793141.653392:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788793141.653451:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788793141.653492:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788793141.653544:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788793141.653595:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788793141.653630:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788793141.653678:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788793141.653743:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788793141.653782:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788793141.653814:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788793141.653860:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788793141.653895:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788793141.653939:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461205120:0@lo:502: 00000100:00100000:2.0:1788793141.654011:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793141.655211:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793141.655291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205120 00000100:00100000:3.0:1788793141.655300:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205120 00000100:00100000:3.0:1788793141.655352:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788793141.655374:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461205120:12345-0@lo:502: 00000100:00100000:3.0:1788793141.655617:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461205120:12345-0@lo:502: Request processed in 245us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793141.655625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788793141.655845:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461205120:0@lo:502: 00000040:00080000:2.0:1788793141.655948:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788793141.655962:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788793141.656634:0:6708:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788793141.656648:0:6708:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9264ba618000) 00000020:00000080:3.0:1788793141.656666:0:6708:0:(obd_config.c:716:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788793141.656855:0:6708:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9264b9db6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788793141.656860:0:6708:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9264b9db6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788793141.656863:0:6708:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9264b9db6800 3 00010000:00080000:3.0:1788793141.656890:0:6708:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9264bf3f1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788793141.660886:0:6708:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788793141.661492:0:6708:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788793141.661543:0:6708:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788793141.661555:0:6708:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa112893a8a83cd09 00000100:00080000:3.0:1788793141.661565:0:6708:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788793141.661576:0:6708:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9264bf3f1800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:3.0:1788793141.661611:0:6708:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9264adf51180 x1875685461205248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788793141.661634:0:6708:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788793141.661691:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875685461205376:0@lo:400: 00000100:00100000:3.0:1788793141.661897:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793141.662049:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875685461205248:0@lo:38: 00000100:00100000:1.0:1788793141.662083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793141.662123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205376 00000100:00100000:1.0:1788793141.662130:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205376 00000100:00100000:1.0:1788793141.662184:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205248 00000100:00100000:1.0:1788793141.662188:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205248 00000100:00100000:1.0:1788793141.662202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.662212:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875685461205376:12345-0@lo:400: 00000100:00100000:1.0:1788793141.662254:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875685461205376:12345-0@lo:400: Request processed in 44us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.662260:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.662276:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788793141.662280:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875685461205248:12345-0@lo:38: 00010000:00080000:1.0:1788793141.662315:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1788793141.662354:0:5835:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa112893a8a83cd10 00000004:00100000:1.0:1788793141.662368:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788793141.662394:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9264b434a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788793141.662433:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875685461205248:12345-0@lo:38: Request processed in 151us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.662440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788793141.662472:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9264adf51180 x1875685461205248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793141.662483:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788793141.662491:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788793141.662497:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788793141.662502:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788793141.662504:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9264bf3f1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788793141.662509:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875685461205248:0@lo:38: 00010000:00080000:3.0:1788793141.663856:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9264adf50a80 x1875685461205376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793141.663872:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875685461205376:0@lo:400: 00000040:00080000:1.0:1788793141.666127:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788793141.668327:0:6683:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788793141.668386:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788793141.668410:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.668424:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788793141.668475:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788793141.668477:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788793141.668478:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793141.668479:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793141.668480:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793141.668482:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793141.668484:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793141.668485:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793141.668486:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793141.668487:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793141.668489:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788793141.668493:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788793141.668495:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788793141.668496:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788793141.668497:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793141.668498:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793141.668499:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793141.668500:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793141.668501:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793141.668502:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793141.668503:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793141.668504:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793141.668505:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788793141.668653:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788793141.668673:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461205504:0@lo:253: 00000100:00100000:3.0:1788793141.668816:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.668900:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff926486155e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793141.672646:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205504 00000100:00100000:0.0:1788793141.672663:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205504 00000100:00100000:0.0:1788793141.673477:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788793141.673491:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:6683:x1875685461205504:12345-0@lo:253: 20000000:01000000:0.0:1788793141.673534:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788793141.673546:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788793141.704408:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788793141.704464:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788793141.705629:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788793141.705637:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788793141.705672:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.705691:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.705699:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.705748:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.705761:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 13 pid: 5829 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793141.705776:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461205632:0@lo:104: 00000100:00100000:0.0:1788793141.705839:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793141.705893:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf1c0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788793141.706224:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205632 00000100:00100000:1.0:1788793141.706233:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205632 00000100:00100000:1.0:1788793141.706276:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788793141.706286:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461205632:12345-0@lo:104: 00010000:00010000:1.0:1788793141.706299:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706374:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788793141.706381:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461205632:12345-0@lo:104: Request processed in 97us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.706397:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788793141.706430:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793141.706436:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706444:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481636c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1788793141.706447:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706455:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793141.706462:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793141.706468:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793141.706493:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706499:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793141.706638:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706646:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cc6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc76 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793141.706662:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793141.706664:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793141.706665:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793141.706683:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461205760:0@lo:103: 00000100:00100000:1.0:1788793141.706733:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793141.706816:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461205632:0@lo:104: 00010000:00010000:3.0:1788793141.706837:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793141.712402:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205760 00000100:00100000:0.0:1788793141.712418:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205760 00010000:00010000:0.0:1788793141.712457:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 14 pid: 5829 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793141.712496:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793141.712505:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926491ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3309:x1875685461205760:12345-0@lo:103: 00010000:00010000:0.0:1788793141.712526:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793141.712531:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 14 pid: 5829 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712542:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 14 pid: 5829 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712573:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5400/0xa112893a8a83cc76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cc6f expref: 14 pid: 5829 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712590:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712598:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788793141.712614:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006978138s 00010000:00010000:0.0:1788793141.712619:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712626:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712632:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712638:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712644:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f4a00 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:0.0:1788793141.712648:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712656:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712672:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793141.712693:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793141.712782:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926491ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461205760:12345-0@lo:103: Request processed in 277us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793141.712790:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788793141.712989:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.713006:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793141.713011:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd17 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793141.714793:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461205760:0@lo:103: 00000100:00100000:1.0:1788793141.716856:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:6683:x1875685461205504:12345-0@lo:253: Request processed in 43362us (48033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793141.716870:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788793141.716979:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:6683:1875685461205504:0@lo:253: 10000000:01000000:3.0:1788793141.717001:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788793141.717005:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788793141.717007:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788793141.717008:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788793141.717009:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788793141.717010:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788793141.717012:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788793141.717013:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788793141.717014:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788793141.717015:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788793141.717017:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788793141.717018:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788793141.717314:0:6683:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788793141.722963:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788793141.723708:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788793141.723933:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788793141.724474:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788793141.724822:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788793141.725953:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788793141.728447:0:6683:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788793141.905367:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788793141.995492:0:6683:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788793141.995498:0:6683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788793141.995539:0:6683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788793141.995593:0:6683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788793141.995608:0:6683:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788793141.995636:0:6683:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788793142.943363:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793143.957700:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793144.977544:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793146.006819:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793147.032000:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793147.152739:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461205888:0@lo:400: 00000100:00100000:3.0:1788793147.152822:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793147.152872:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793147.152877:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461206016:0@lo:400: 00000100:00100000:3.0:1788793147.152899:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793147.152926:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461206144:0@lo:400: 00000100:00100000:3.0:1788793147.152948:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793147.153209:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461205888 00000100:00100000:3.0:1788793147.153217:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461205888 00000100:00100000:3.0:1788793147.153266:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788793147.153275:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3310:x1875685461205888:12345-0@lo:400: 00000100:00100000:3.0:1788793147.153341:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3310:x1875685461205888:12345-0@lo:400: Request processed in 66us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793147.153348:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788793147.153379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206016 00000100:00100000:3.0:1788793147.153382:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206016 00000100:00100000:3.0:1788793147.153405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206144 00000100:00100000:3.0:1788793147.153408:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206144 00000100:00100000:3.0:1788793147.153479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788793147.153505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461206016:12345-0@lo:400: 00000100:00100000:3.0:1788793147.153540:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461206016:12345-0@lo:400: Request processed in 56us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793147.153546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788793147.153558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788793147.153563:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461206144:12345-0@lo:400: 00000100:00100000:3.0:1788793147.153591:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461206144:12345-0@lo:400: Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793147.153595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788793147.153651:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf53480 x1875685461206144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793147.153665:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461206144:0@lo:400: 00010000:00080000:3.0:1788793147.153796:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf51880 x1875685461206016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793147.153805:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461206016:0@lo:400: 00000100:00100000:3.0:1788793147.153812:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461205888:0@lo:400: 00000100:00080000:3.0:1788793147.153942:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788793148.050805:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788793149.047040:0:7052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788793149.073559:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788793149.200469:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793149.200476:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926488cd7800 from 21 10000000:01000000:2.0:1788793149.200481:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793149.200523:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.200535:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.200547:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793149.200571:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206272:0@lo:101: 00000100:00100000:2.0:1788793149.201002:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.201086:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf688f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793149.203434:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206272 00000100:00100000:1.0:1788793149.203447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206272 00000100:00100000:1.0:1788793149.203499:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788793149.203509:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461206272:12345-0@lo:101: 00010000:00010000:1.0:1788793149.203524:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793149.203541:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd1e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793149.203569:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793149.203580:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793149.203801:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a10200, rc 0) 00000100:00100000:3.0:1788793149.203975:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206272:0@lo:101: 00010000:00010000:3.0:1788793149.203993:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793149.204003:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793149.204067:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206400:0@lo:501: 00000100:00100000:3.0:1788793149.204101:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.204130:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.204160:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206400 00000100:00100000:3.0:1788793149.204163:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206400 00000100:00100000:3.0:1788793149.204183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788793149.204189:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461206400:12345-0@lo:501: 00000100:00100000:3.0:1788793149.204711:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461206400:12345-0@lo:501: Request processed in 521us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.204719:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788793149.204764:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206400:0@lo:501: 00000100:00100000:3.0:1788793149.204791:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206528:0@lo:503: 00000100:00100000:3.0:1788793149.204826:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.204841:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.204852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206528 00000100:00100000:3.0:1788793149.204855:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206528 00000100:00100000:3.0:1788793149.204872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788793149.204947:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461206528:12345-0@lo:503: 00000100:00100000:1.0:1788793149.205390:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461206272:12345-0@lo:101: Request processed in 370us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793149.205397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788793149.205716:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461206528:12345-0@lo:503: Request processed in 837us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.205723:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788793149.206994:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206528:0@lo:503: 00000100:00100000:0.0:1788793149.207771:0:7067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7067:1875685461206656:0@lo:502: 00000100:00100000:0.0:1788793149.207828:0:7067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793149.207874:0:7067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b1741cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.207984:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206656 00000100:00100000:3.0:1788793149.207991:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206656 00000100:00100000:3.0:1788793149.208033:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788793149.208043:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7067:x1875685461206656:12345-0@lo:502: 00000100:00100000:3.0:1788793149.208997:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7067:x1875685461206656:12345-0@lo:502: Request processed in 953us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.209005:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788793149.213755:0:7067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7067:1875685461206656:0@lo:502: 00000100:00100000:0.0:1788793149.213865:0:7067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7067:1875685461206784:0@lo:502: 00000100:00100000:0.0:1788793149.214372:0:7067:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793149.214419:0:7067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b1741cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.214977:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206784 00000100:00100000:3.0:1788793149.214985:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206784 00000100:00100000:3.0:1788793149.215037:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788793149.215047:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7067:x1875685461206784:12345-0@lo:502: 00000100:00100000:3.0:1788793149.215331:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7067:x1875685461206784:12345-0@lo:502: Request processed in 286us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.215339:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788793149.215907:0:7067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7067:1875685461206784:0@lo:502: 00000040:00080000:0.0:1788793149.215943:0:7067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788793149.216130:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788793149.216177:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788793149.216196:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793149.216215:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793149.216224:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788793149.216227:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926488cd7800 from 4 10000000:01000000:3.0:1788793149.216229:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788793149.216271:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793149.216279:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793149.216300:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793149.216318:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206912:0@lo:101: 00000100:00100000:3.0:1788793149.216356:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.216384:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.217378:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461206912 00000100:00100000:0.0:1788793149.217386:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461206912 00000100:00100000:0.0:1788793149.217430:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788793149.217438:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461206912:12345-0@lo:101: 00010000:00010000:0.0:1788793149.217451:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793149.217468:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd2c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.217503:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.217513:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.217522:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4600, rc 0) 00000100:00100000:0.0:1788793149.217695:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461206912:12345-0@lo:101: Request processed in 257us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.217701:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788793149.217747:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461206912:0@lo:101: 00010000:00010000:0.0:1788793149.217760:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.217769:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793149.217817:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207040:0@lo:256: 00000100:00100000:0.0:1788793149.217848:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793149.217871:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b17413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.217885:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207040 00000100:00100000:0.0:1788793149.217888:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207040 00000100:00100000:0.0:1788793149.217910:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788793149.217916:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461207040:12345-0@lo:256: 20000000:01000000:0.0:1788793149.217929:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788793149.217946:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788793149.217949:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788793149.218022:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461207040:12345-0@lo:256: Request processed in 105us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.218027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788793149.218055:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207040:0@lo:256: 10000000:01000000:0.0:1788793149.218090:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788793149.218096:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.218103:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793149.218109:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788793149.218111:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788793149.218113:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788793149.218128:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.218134:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.218162:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793149.218173:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207168:0@lo:101: 00000100:00100000:0.0:1788793149.218195:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793149.218217:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b17413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.218229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207168 00000100:00100000:0.0:1788793149.218232:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207168 00000100:00100000:0.0:1788793149.218262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788793149.218268:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461207168:12345-0@lo:101: 00010000:00010000:0.0:1788793149.218279:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793149.220487:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd3a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.220522:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.220534:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.220543:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4a00, rc 0) 00000100:00100000:0.0:1788793149.220717:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461207168:12345-0@lo:101: Request processed in 2448us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.220725:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788793149.220784:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207168:0@lo:101: 00010000:00010000:0.0:1788793149.220799:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.220810:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793149.221673:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207296:0@lo:501: 00000100:00100000:0.0:1788793149.221715:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793149.221748:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490b98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.221772:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207296 00000100:00100000:0.0:1788793149.221777:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207296 00000100:00100000:0.0:1788793149.221813:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788793149.221821:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461207296:12345-0@lo:501: 00000100:00100000:0.0:1788793149.222891:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461207296:12345-0@lo:501: Request processed in 1058us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.222899:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788793149.223465:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207296:0@lo:501: 00000100:00100000:2.0:1788793149.223512:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207424:0@lo:503: 00000100:00100000:2.0:1788793149.223561:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.223949:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf688600 going to sleep for 11 seconds 00000100:00100000:2.0:1788793149.223966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207424 00000100:00100000:2.0:1788793149.223975:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207424 00000100:00100000:2.0:1788793149.224014:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788793149.224021:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461207424:12345-0@lo:503: 00000100:00100000:2.0:1788793149.225983:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461207424:12345-0@lo:503: Request processed in 1957us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793149.225995:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788793149.226069:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461207424:0@lo:503: 00000100:00100000:3.0:1788793149.234568:0:7069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7069:1875685461207552:0@lo:502: 00000100:00100000:3.0:1788793149.234666:0:7069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.234716:0:7069:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.234810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207552 00000100:00100000:0.0:1788793149.234817:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207552 00000100:00100000:0.0:1788793149.234867:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788793149.234876:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:7069:x1875685461207552:12345-0@lo:502: 00000100:00100000:0.0:1788793149.235184:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:7069:x1875685461207552:12345-0@lo:502: Request processed in 309us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.235192:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788793149.235551:0:7069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7069:1875685461207552:0@lo:502: 00000020:01000000:3.0:1788793149.235579:0:7069:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788793149.235597:0:7069:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788793149.235603:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793149.235606:0:7069:0:(obd_config.c:1547:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788793149.235617:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788793149.235621:0:7069:0:(obd_config.c:1471:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1788793149.235641:0:7069:0:(obd_config.c:1958:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788793149.235645:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788793149.235659:0:7069:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9264ba6199e8) 00000020:00000080:3.0:1788793149.235679:0:7069:0:(obd_config.c:716:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788793149.235685:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788793149.235749:0:7069:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788793149.235755:0:7069:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788793149.235762:0:7069:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83cd4f 00010000:00080000:3.0:1788793149.235789:0:7069:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9264b6139800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788793149.236019:0:7069:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788793149.336275:0:7069:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788793149.336492:0:7069:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788793149.337526:0:7069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788793149.338529:0:7069:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788793149.338646:0:7069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788793149.338713:0:7069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788793149.341839:0:7074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788793149.341846:0:7074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788793149.342601:0:7069:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788793149.342613:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788793149.342644:0:7069:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788793149.342663:0:7069:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa112893a8a83cd56 00000100:00080000:2.0:1788793149.342674:0:7069:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793149.342686:0:7069:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9264b6139800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788793149.342719:0:7069:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9264ba759180 x1875685461207680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793149.342747:0:7069:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788793149.342807:0:7069:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793149.342811:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793149.342813:0:7069:0:(obd_config.c:1547:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788793149.342816:0:7069:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793149.342819:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793149.342820:0:7069:0:(obd_config.c:1547:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793149.342823:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793149.342831:0:7069:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788793149.342858:0:7069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7069:1875685461207808:0@lo:502: 00000100:00100000:3.0:1788793149.343065:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461207936:0@lo:400: 00000100:00100000:3.0:1788793149.343121:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.343203:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461208064:0@lo:400: 00000100:00100000:3.0:1788793149.343237:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.343271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207936 00000100:00100000:3.0:1788793149.343278:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207936 00000100:00100000:3.0:1788793149.343392:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208064 00000100:00100000:3.0:1788793149.343396:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208064 00000100:00100000:3.0:1788793149.343421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788793149.343429:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461207936:12345-0@lo:400: 00000100:00100000:2.0:1788793149.343790:0:7069:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.343812:0:7069:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf688d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788793149.343826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207808 00000100:00100000:2.0:1788793149.343831:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207808 00000100:00100000:2.0:1788793149.343856:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788793149.343863:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:7069:x1875685461207808:12345-0@lo:502: 00000100:00100000:3.0:1788793149.343979:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461207936:12345-0@lo:400: Request processed in 550us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.343998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788793149.344014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793149.344020:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461208064:12345-0@lo:400: 00000100:00100000:3.0:1788793149.344055:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461208064:12345-0@lo:400: Request processed in 35us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.344061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788793149.344080:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788793149.344106:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf53480 x1875685461207936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793149.344118:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461207936:0@lo:400: 00010000:00080000:3.0:1788793149.344158:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf50000 x1875685461208064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793149.344167:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461208064:0@lo:400: 00000100:00100000:1.0:1788793149.344269:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875685461207680:0@lo:8: 00000100:00100000:1.0:1788793149.344465:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.345795:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:7069:x1875685461207808:12345-0@lo:502: Request processed in 1929us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793149.345805:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788793149.345860:0:7069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7069:1875685461207808:0@lo:502: 00000020:01000000:2.0:1788793149.345944:0:7069:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793149.345951:0:7069:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793149.345953:0:7069:0:(obd_config.c:1547:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788793149.345958:0:7069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788793149.346051:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788793149.346068:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788793149.346077:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.346088:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793149.346097:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788793149.346100:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff926488538000 from 1 10000000:01000000:2.0:1788793149.346103:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788793149.346129:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.346165:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.346175:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793149.346192:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461208192:0@lo:101: 00000100:00100000:2.0:1788793149.346232:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.346408:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461207680 00000100:00100000:3.0:1788793149.346415:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461207680 00000100:00100000:3.0:1788793149.346449:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793149.346456:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875685461207680:12345-0@lo:8: 00010000:00080000:3.0:1788793149.346476:0:6686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1788793149.346506:0:6686:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa112893a8a83cd64 00002000:00100000:3.0:1788793149.346544:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff926491110000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788793149.346549:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788793149.346552:0:6686:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788793149.346729:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788793149.346858:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788793149.347057:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf688d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788793149.347074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208192 00000100:00100000:2.0:1788793149.347078:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208192 00000100:00100000:2.0:1788793149.347107:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788793149.347113:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461208192:12345-0@lo:101: 00010000:00010000:2.0:1788793149.347124:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793149.347137:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd5d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.347193:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.347212:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.347221:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481637600, rc 0) 00000100:00080000:3.0:1788793149.347392:0:6686:0:(import.c:65:import_set_state_nolock()) ffff926491110800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793149.347447:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875685461207680:12345-0@lo:8: Request processed in 990us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.347455:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788793149.347543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba759180 x1875685461207680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788793159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793149.347553:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788793149.347560:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788793149.347567:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788793149.347572:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788793149.347574:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9264b6139800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788793149.347960:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788793149.347967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875685461207680:0@lo:8: 00000100:00100000:2.0:1788793149.348038:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461208192:12345-0@lo:101: Request processed in 924us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793149.348044:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788793149.348083:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461208192:0@lo:101: 00010000:00010000:2.0:1788793149.348106:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793149.348116:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793149.348188:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461208320:0@lo:501: 00000100:00100000:2.0:1788793149.348228:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788793149.348436:0:7074:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788793149.348549:0:7074:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169588408434ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788793149.349129:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf688d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788793149.359818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208320 00000100:00100000:0.0:1788793149.359831:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208320 00000100:00100000:0.0:1788793149.359888:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788793149.359898:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461208320:12345-0@lo:501: 00000100:00100000:0.0:1788793149.360103:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461208320:12345-0@lo:501: Request processed in 207us (11873us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793149.360111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788793149.360189:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461208320:0@lo:501: 10000000:01000000:0.0:1788793149.360232:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788793149.360751:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793149.360763:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788793149.390095:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788793149.437590:0:7075:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788793149.437622:0:7075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208576:0@lo:7: 00000100:00100000:2.0:1788793149.437690:0:7075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.437734:0:7075:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488d8c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793149.437769:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208576 00000100:00100000:2.0:1788793149.437776:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208576 00000100:00100000:2.0:1788793149.437827:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788793149.437836:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7075:x1875685461208576:12345-0@lo:7: 00000100:00100000:3.0:1788793149.437959:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461208448:0@lo:13: 00000100:00100000:3.0:1788793149.437994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.438047:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208448 00000100:00100000:3.0:1788793149.438051:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208448 00000100:00100000:3.0:1788793149.438077:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793149.438083:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875685461208448:12345-0@lo:13: 00002000:00000024:3.0:1788793149.438104:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788793149.438171:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875685461208448:12345-0@lo:13: Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.438177:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788793149.438221:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba75bb80 x1875685461208448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793149.438249:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461208448:0@lo:13: 00000100:00080000:3.0:1788793149.439216:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788793149.446518:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788793149.446526:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788793149.446729:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7075:x1875685461208576:12345-0@lo:7: Request processed in 8891us (9036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.446740:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788793149.446808:0:7075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba759880 x1875685461208576/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788793165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793149.446822:0:7075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208576:0@lo:7: 00000004:00080000:2.0:1788793149.446836:0:7075:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788793149.446949:0:7075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208704:0@lo:5: 00000100:00100000:2.0:1788793149.446981:0:7075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.447070:0:7075:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488d8c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793149.447129:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208704 00000100:00100000:1.0:1788793149.447136:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208704 00000100:00100000:0.0:1788793149.447596:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788793149.447607:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7075:x1875685461208704:12345-0@lo:5: 00002000:00080000:0.0:1788793149.447634:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788793149.447638:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788793149.447941:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7075:x1875685461208704:12345-0@lo:5: Request processed in 334us (957us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788793149.447948:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788793149.448166:0:7075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba759880 x1875685461208704/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793149.448198:0:7075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208704:0@lo:5: 00000004:00080000:2.0:1788793149.448215:0:7075:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788793149.448255:0:7075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208832:0@lo:700: 00000100:00100000:2.0:1788793149.448420:0:7075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.448486:0:7075:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488d8c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.448646:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208832 00000100:00100000:3.0:1788793149.448652:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208832 00000100:00100000:3.0:1788793149.448722:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788793149.448742:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7075:x1875685461208832:12345-0@lo:700: 00000100:00100000:3.0:1788793149.448773:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875685461208960:0@lo:700: 00000100:00100000:3.0:1788793149.448802:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793149.448865:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788793149.448986:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461208960 00000100:00100000:1.0:1788793149.448991:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461208960 00000100:00100000:1.0:1788793149.449061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793149.449069:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875685461208960:12345-0@lo:700: 40000000:02000000:1.0:1788793149.478416:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788793149.484668:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875685461208960:12345-0@lo:700: Request processed in 35589us (35853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793149.484688:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788793149.484774:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf53480 x1875685461208960/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788793165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793149.484789:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875685461208960:0@lo:700: 40000000:02000000:3.0:1788793149.484802:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788793149.570194:0:6712:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788793149.570223:0:6712:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788793149.573557:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba758000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7075:x1875685461208832:12345-0@lo:700: Request processed in 124807us (125127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793149.573571:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788793149.573809:0:7075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba758380 x1875685461208832/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788793165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793149.573822:0:7075:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788793149.573841:0:7075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461208832:0@lo:700: 00000004:02000040:2.0:1788793149.615265:0:7075:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788793149.624725:0:7075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461209088:0@lo:5: 00000100:00100000:2.0:1788793149.624798:0:7075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793149.624860:0:7075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b17413c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788793149.624939:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209088 00000100:00100000:3.0:1788793149.624948:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209088 00000100:00100000:3.0:1788793149.625005:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788793149.625015:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7075:x1875685461209088:12345-0@lo:5: 00002000:00080000:2.0:1788793149.655896:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788793149.655922:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788793149.668888:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba759880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7075:x1875685461209088:12345-0@lo:5: Request processed in 43868us (44083us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788793149.668901:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788793149.676814:0:7075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba758380 x1875685461209088/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793149.676837:0:7075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7075:1875685461209088:0@lo:5: 00000004:00080000:0.0:1788793149.676854:0:7075:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788793150.096547:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793151.120468:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793152.146218:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793153.178786:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793154.192318:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793154.832413:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461209344:0@lo:400: 00000100:00100000:3.0:1788793154.832530:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793154.832601:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793154.832609:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461209216:0@lo:400: 00000100:00100000:3.0:1788793154.832639:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793154.832671:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461209472:0@lo:400: 00000100:00100000:3.0:1788793154.832693:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793154.832724:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793154.832729:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264adf52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461209600:0@lo:400: 00000100:00100000:3.0:1788793154.832764:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793154.833019:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209344 00000100:00100000:3.0:1788793154.833027:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209344 00000100:00100000:3.0:1788793154.833105:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209472 00000100:00100000:3.0:1788793154.833118:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209472 00000100:00100000:1.0:1788793154.833238:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461209728:0@lo:13: 00000100:00100000:1.0:1788793154.833268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793154.833304:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209728 00000100:00100000:1.0:1788793154.833308:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209728 00000100:00100000:1.0:1788793154.833339:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788793154.833348:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875685461209728:12345-0@lo:13: 00002000:00000024:1.0:1788793154.833381:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793154.833426:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875685461209728:12345-0@lo:13: Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793154.833433:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788793154.833470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264b966f100 x1875685461209728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793154.833488:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461209728:0@lo:13: 00000100:00100000:0.0:1788793154.835202:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209600 00000100:00100000:0.0:1788793154.835215:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209600 00000100:00100000:0.0:1788793154.835254:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793154.835262:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875685461209600:12345-0@lo:400: 00000100:00100000:0.0:1788793154.835331:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875685461209600:12345-0@lo:400: Request processed in 70us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793154.835345:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788793154.835369:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793154.835377:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461209344:12345-0@lo:400: 00000100:00100000:0.0:1788793154.835424:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461209344:12345-0@lo:400: Request processed in 48us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793154.835430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793154.835444:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793154.835450:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461209472:12345-0@lo:400: 00000100:00100000:0.0:1788793154.835476:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461209472:12345-0@lo:400: Request processed in 27us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793154.835480:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793154.835496:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209216 00000100:00100000:0.0:1788793154.835499:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209216 00000100:00100000:0.0:1788793154.835522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788793154.835528:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3309:x1875685461209216:12345-0@lo:400: 00000100:00100000:0.0:1788793154.835557:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3309:x1875685461209216:12345-0@lo:400: Request processed in 29us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793154.835562:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788793154.836355:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461209216:0@lo:400: 00010000:00080000:1.0:1788793154.836372:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf51180 x1875685461209344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793154.836383:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461209344:0@lo:400: 00000100:00080000:3.0:1788793154.836975:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788793154.836981:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788793154.837018:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf52d80 x1875685461209600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793154.837029:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461209600:0@lo:400: 00010000:00080000:3.0:1788793154.837040:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264adf51500 x1875685461209472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793154.837048:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264adf51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461209472:0@lo:400: 00000001:00080000:0.0:1788793154.887744:0:6712:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788793155.217274:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793156.241644:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793157.268672:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793158.288331:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793159.319330:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793159.954110:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461210240:0@lo:400: 00000100:00100000:3.0:1788793159.954198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793159.954273:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793159.954280:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461209856:0@lo:400: 00000100:00100000:3.0:1788793159.954311:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793159.954344:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461209984:0@lo:400: 00000100:00100000:3.0:1788793159.954370:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793159.954390:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793159.954396:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461210112:0@lo:400: 00000100:00100000:3.0:1788793159.954417:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793159.954487:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209856 00000100:00100000:3.0:1788793159.954495:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209856 00000100:00100000:3.0:1788793159.954538:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788793159.954547:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3308:x1875685461209856:12345-0@lo:400: 00000100:00100000:3.0:1788793159.954609:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3308:x1875685461209856:12345-0@lo:400: Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793159.954632:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788793159.954665:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461209984 00000100:00100000:3.0:1788793159.954669:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461209984 00000100:00100000:3.0:1788793159.954694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210112 00000100:00100000:3.0:1788793159.954697:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210112 00000100:00100000:3.0:1788793159.954719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788793159.954725:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461209984:12345-0@lo:400: 00000100:00100000:3.0:1788793159.954772:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461209984:12345-0@lo:400: Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793159.954779:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788793159.954792:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793159.954797:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461210112:12345-0@lo:400: 00000100:00100000:3.0:1788793159.954824:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461210112:12345-0@lo:400: Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793159.954830:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788793159.954854:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788793159.954879:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92649113e300 x1875685461210112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793159.954894:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461210112:0@lo:400: 00010000:00080000:3.0:1788793159.954904:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92649113f800 x1875685461209984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793159.954911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461209984:0@lo:400: 00000100:00100000:3.0:1788793159.954935:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461209856:0@lo:400: 00000100:00100000:0.0:1788793159.955406:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210240 00000100:00100000:0.0:1788793159.955412:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210240 00000100:00100000:0.0:1788793159.955460:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793159.955468:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461210240:12345-0@lo:400: 00000100:00100000:0.0:1788793159.955511:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461210240:12345-0@lo:400: Request processed in 45us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793159.955518:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788793159.962181:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793159.962242:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92649113d500 x1875685461210240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793159.962256:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788793159.962276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461210240:0@lo:400: 00000100:00100000:3.0:1788793159.976646:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793159.976673:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461210368:0@lo:13: 00000100:00100000:3.0:1788793159.976764:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793159.976942:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210368 00000100:00100000:2.0:1788793159.976950:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210368 00000100:00100000:2.0:1788793159.977004:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793159.977014:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461210368:12345-0@lo:13: 00002000:00000024:2.0:1788793159.977057:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788793159.977104:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461210368:12345-0@lo:13: Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793159.977112:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788793159.978551:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba758700 x1875685461210368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793159.978576:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461210368:0@lo:13: 00010000:00010000:2.0:1788793160.341220:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793161.364130:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793162.389031:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793163.408566:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788793163.630424:0:7625:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788793163.630427:0:7625:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788793163.630564:0:7625:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff926491114800 00000020:01000004:3.0:1788793163.630589:0:7625:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788793163.630601:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788793163.630614:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9264ba61b3d0) 00000020:00000080:3.0:1788793163.630628:0:7625:0:(obd_config.c:716:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788793163.656804:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788793163.657065:0:7625:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788793163.692686:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788793163.699603:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788793163.699635:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788793163.699692:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788793163.699718:0:7625:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788793163.700073:0:7625:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788793163.700085:0:7625:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788793163.700097:0:7625:0:(genops.c:1375:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa112893a8a83cd79 00000020:01000004:2.0:1788793163.700104:0:7625:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788793163.700124:0:7625:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788793163.700128:0:7625:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788793163.700135:0:7625:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788793163.700194:0:7625:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788793163.700198:0:7625:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788793163.737612:0:7625:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788793163.737664:0:7625:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.106@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788793163.737672:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788793163.737674:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788793163.737675:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793163.737676:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793163.737678:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793163.737679:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793163.737680:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793163.737681:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793163.737683:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793163.737685:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793163.737686:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788793163.737689:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788793163.737691:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788793163.737693:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788793163.737694:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788793163.737695:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788793163.737696:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788793163.737697:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788793163.737698:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788793163.737699:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788793163.737700:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788793163.737701:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788793163.737702:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788793163.737740:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788793163.737760:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461210496:0@lo:253: 00000100:00100000:2.0:1788793163.738276:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793163.738559:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488cf2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.739512:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210496 00000100:00100000:0.0:1788793163.739526:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210496 00000100:00100000:0.0:1788793163.739645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788793163.739656:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:7625:x1875685461210496:12345-0@lo:253: 20000000:01000000:0.0:1788793163.739707:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788793163.739712:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788793163.739718:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788793163.739721:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788793163.744218:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788793163.745591:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788793163.745612:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788793163.745667:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788793163.745676:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788793163.745708:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788793163.745776:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788793163.746506:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788793163.746528:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788793163.746530:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788793163.746566:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788793163.746574:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788793163.746620:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788793163.746629:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788793163.746662:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788793163.746671:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788793163.746704:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788793163.746758:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788793163.748033:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788793163.748058:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.106@tcp 20000000:01000000:0.0:1788793163.748060:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788793163.748108:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788793163.748115:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788793163.748184:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788793163.748192:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.106@tcp (null) (null) 00000040:00080000:0.0:1788793163.748223:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788793163.748231:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788793163.748289:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788793163.748326:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788793163.748671:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788793163.748675:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788793163.748681:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788793163.748682:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788793163.748684:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788793163.748696:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788793163.748699:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788793163.748732:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788793163.748735:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788793163.752603:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788793163.752690:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788793163.752750:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788793163.753244:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788793163.753288:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788793163.753439:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788793163.753454:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788793163.753457:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788793163.754293:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788793163.755741:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788793163.755786:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788793163.755982:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788793163.755997:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788793163.756000:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788793163.757135:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788793163.757231:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788793163.757287:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788793163.758282:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788793163.759005:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788793163.759056:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788793163.759070:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788793163.759072:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788793163.765618:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788793163.765731:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788793163.765766:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788793163.766694:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788793163.766754:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788793163.766819:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788793163.766909:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788793163.766929:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766947:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccca expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766967:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766974:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766982:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766989:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.766996:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767033:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767050:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 16 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793163.767066:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210624:0@lo:104: 00000100:00100000:2.0:1788793163.767136:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793163.767212:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767221:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 16 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793163.767231:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210752:0@lo:104: 00010000:00010000:2.0:1788793163.767255:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767263:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 16 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793163.767271:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210880:0@lo:104: 00010000:00010000:2.0:1788793163.767295:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767304:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 16 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793163.767311:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461211008:0@lo:104: 00010000:00010000:2.0:1788793163.767907:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.767920:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 16 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793163.767931:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461211136:0@lo:104: 00000100:00100000:2.0:1788793163.767969:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488cf2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.768081:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788793163.768102:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.768131:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.768161:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.768172:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.768183:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210624 00000100:00100000:0.0:1788793163.768191:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210624 00000100:00100000:0.0:1788793163.768226:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210752 00000100:00100000:0.0:1788793163.768229:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210752 00000100:00100000:0.0:1788793163.768239:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461210880 00000100:00100000:0.0:1788793163.768242:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461210880 00000100:00100000:0.0:1788793163.768252:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211008 00000100:00100000:0.0:1788793163.768255:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211008 00000100:00100000:0.0:1788793163.768262:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211136 00000100:00100000:0.0:1788793163.768264:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211136 00000100:00100000:0.0:1788793163.768275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788793163.768283:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649147b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+7:5828:x1875685461210624:12345-0@lo:104: 00010000:00010000:0.0:1788793163.768296:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.768510:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793163.768517:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649147b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+7:5828:x1875685461210624:12345-0@lo:104: Request processed in 234us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.768524:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788793163.768563:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793163.768570:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5828:x1875685461210752:12345-0@lo:104: 00010000:00010000:0.0:1788793163.768577:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.768619:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788793163.768624:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:5828:x1875685461210752:12345-0@lo:104: Request processed in 56us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.768640:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793163.768654:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793163.768660:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:5828:x1875685461210880:12345-0@lo:104: 00010000:00010000:0.0:1788793163.768668:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.768704:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788793163.768708:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:5828:x1875685461210880:12345-0@lo:104: Request processed in 49us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.768713:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788793163.768722:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793163.768727:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:5828:x1875685461211008:12345-0@lo:104: 00010000:00010000:0.0:1788793163.768734:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.768759:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788793163.768763:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:5828:x1875685461211008:12345-0@lo:104: Request processed in 37us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.768768:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788793163.768779:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788793163.768784:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5828:x1875685461211136:12345-0@lo:104: 00010000:00010000:0.0:1788793163.768791:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.768816:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788793163.768821:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5828:x1875685461211136:12345-0@lo:104: Request processed in 38us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793163.768950:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210624:0@lo:104: 00000100:00100000:3.0:1788793163.768972:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210752:0@lo:104: 00000100:00100000:3.0:1788793163.768979:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461210880:0@lo:104: 00000100:00100000:3.0:1788793163.768985:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461211008:0@lo:104: 00000100:00100000:3.0:1788793163.768992:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5828:1875685461211136:0@lo:104: 00010000:00010000:3.0:1788793163.769017:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769083:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788793163.769094:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769102:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481636c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793163.769107:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769115:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793163.769122:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793163.769128:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793163.769221:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769229:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793163.769247:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769254:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cd5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd6b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769268:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788793163.769271:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769277:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f4c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793163.769281:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.769299:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793163.769306:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793163.769312:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793163.769378:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788793163.769384:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.769391:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481636600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1788793163.769394:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.769401:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793163.769409:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793163.769415:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788793163.769487:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788793163.769504:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788793163.774246:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211264:0@lo:103: 00000100:00100000:3.0:1788793163.774322:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793163.774826:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774847:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793163.774860:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774866:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9264880f4c00/0xa112893a8a83cd3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd41 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774880:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788793163.774884:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774891:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481505000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793163.774894:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774904:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793163.774910:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793163.774930:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788793163.774946:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774962:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793163.774979:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774985:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481505000/0xa112893a8a83ccca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccd1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793163.774994:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793163.774996:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793163.774997:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793163.775100:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793163.775107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211392:0@lo:103: 00000100:00100000:3.0:1788793163.775164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793163.775194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461211520:0@lo:103: 00000100:00100000:3.0:1788793163.775229:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793163.775272:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211264 00000100:00100000:3.0:1788793163.775281:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211264 00010000:00010000:3.0:1788793163.775308:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 17 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793163.775325:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211392 00000100:00100000:3.0:1788793163.775328:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211392 00010000:00010000:3.0:1788793163.775352:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 18 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793163.775363:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211520 00000100:00100000:3.0:1788793163.775366:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211520 00010000:00010000:3.0:1788793163.775375:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 19 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793163.775388:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793163.775396:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3310:x1875685461211264:12345-0@lo:103: 00010000:00010000:3.0:1788793163.775410:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793163.775416:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 19 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775439:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 19 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775454:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481637600/0xa112893a8a83cd6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cd5d expref: 19 pid: 5828 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775472:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793163.775508:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:3310:x1875685461211264:12345-0@lo:103: Request processed in 111us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793163.775515:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793163.775530:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788793163.775536:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:3310:x1875685461211392:12345-0@lo:103: 00010000:00010000:3.0:1788793163.775544:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793163.775548:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 17 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775557:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 17 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775569:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cd41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cd3a expref: 17 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775578:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793163.775600:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3310:x1875685461211392:12345-0@lo:103: Request processed in 64us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793163.775606:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788793163.775617:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788793163.775623:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:3308:x1875685461211520:12345-0@lo:103: 00010000:00010000:3.0:1788793163.775636:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793163.775641:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 15 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775650:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 15 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775660:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4200/0xa112893a8a83ccd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83ccca expref: 15 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.775668:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788793163.775692:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3308:x1875685461211520:12345-0@lo:103: Request processed in 70us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793163.775698:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788793163.775732:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461211520:0@lo:103: 00000100:00100000:3.0:1788793163.775753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211392:0@lo:103: 00000100:00100000:3.0:1788793163.775761:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211264:0@lo:103: 00010000:00010000:1.0:1788793163.776195:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776204:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793163.776218:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776226:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481636600/0xa112893a8a83cd1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd25 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776238:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793163.776240:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793163.776241:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793163.776254:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461211648:0@lo:103: 00000100:00100000:1.0:1788793163.776291:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793163.776433:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211648 00000100:00100000:1.0:1788793163.776438:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211648 00010000:00010000:1.0:1788793163.776458:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 14 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793163.776523:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788793163.776531:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3309:x1875685461211648:12345-0@lo:103: 00010000:00010000:1.0:1788793163.776550:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793163.776556:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 14 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776566:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 14 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776576:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926482a10200/0xa112893a8a83cd25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cd1e expref: 14 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793163.776588:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793163.776616:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461211648:12345-0@lo:103: Request processed in 86us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793163.776623:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788793163.776711:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.776714:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.776715:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.777513:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.777525:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481637c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793163.777529:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.777539:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793163.777557:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793163.777563:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793163.777593:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.777599:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793163.777613:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.777621:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ccf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ccfb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.777640:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.777643:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.777644:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793163.777656:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211776:0@lo:103: 00000100:00100000:3.0:1788793163.777694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.790023:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211776 00000100:00100000:0.0:1788793163.790040:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211776 00010000:00010000:0.0:1788793163.790083:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793163.790113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788793163.790121:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3310:x1875685461211776:12345-0@lo:103: 00010000:00010000:0.0:1788793163.790165:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793163.790172:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790186:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790204:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926482a11e00/0xa112893a8a83ccfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83ccf4 expref: 13 pid: 5830 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790221:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790231:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790247:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790255:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790279:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790287:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790295:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481637400 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:0.0:1788793163.790310:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790321:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790603:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.790616:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793163.790690:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3310:x1875685461211776:12345-0@lo:103: Request processed in 569us (12995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.790698:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788793163.790780:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.790790:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.790796:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481637400/0xa112893a8a83cd80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788793163.790814:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788793163.790991:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461211776:0@lo:103: 00000100:00100000:1.0:1788793163.794043:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461211648:0@lo:103: 00000100:00100000:0.0:1788793163.939858:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:7625:x1875685461210496:12345-0@lo:253: Request processed in 200195us (202017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.939874:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788793163.939947:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461210496:0@lo:253: 10000000:01000000:0.0:1788793163.939991:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788793163.939994:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788793163.939996:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788793163.939997:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788793163.939998:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788793163.940013:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788793163.940015:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788793163.940016:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788793163.940018:0:7625:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788793163.940019:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788793163.940020:0:7625:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788793163.940041:0:7625:0:(tgt_mount.c:101:server_register_mount()) register mount ffff926491114800 from lustre-OST0001 10000000:01000000:0.0:1788793163.940065:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788793163.940068:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788793163.940077:0:7625:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff926488538000 local copy 10000000:01000000:0.0:1788793163.940081:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788793163.940117:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940127:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940137:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793163.940178:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461211904:0@lo:101: 00000100:00100000:0.0:1788793163.940215:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.940260:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.940278:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461211904 00000100:00100000:0.0:1788793163.940283:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461211904 00000100:00100000:0.0:1788793163.940346:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788793163.940354:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+11:7625:x1875685461211904:12345-0@lo:101: 00010000:00010000:0.0:1788793163.940366:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793163.940378:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5200/0xa112893a8a83cd8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940400:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5200/0xa112893a8a83cd8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd87 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940420:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5200/0xa112893a8a83cd8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd87 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940428:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5200, rc 0) 00000100:00100000:0.0:1788793163.940460:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461211904:12345-0@lo:101: Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.940466:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788793163.940499:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461211904:0@lo:101: 00010000:00010000:0.0:1788793163.940511:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940520:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793163.940605:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212032:0@lo:501: 00000100:00100000:0.0:1788793163.940642:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.940656:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.940669:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212032 00000100:00100000:0.0:1788793163.940672:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212032 00000100:00100000:0.0:1788793163.940692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788793163.940698:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212032:12345-0@lo:501: 00000100:00100000:0.0:1788793163.940883:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212032:12345-0@lo:501: Request processed in 184us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788793163.940891:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788793163.940923:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212032:0@lo:501: 10000000:01000000:0.0:1788793163.940937:0:7625:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788793163.940980:0:7625:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788793163.940986:0:7625:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.940994:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941002:0:7625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941020:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788793163.941035:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff926491114800 10000000:01000000:0.0:1788793163.941040:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788793163.941045:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788793163.941048:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788793163.941051:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788793163.941054:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788793163.941067:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941076:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941084:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793163.941095:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212160:0@lo:101: 00000100:00100000:0.0:1788793163.941119:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.941131:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.941169:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212160 00000100:00100000:0.0:1788793163.941178:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212160 00000100:00100000:0.0:1788793163.941200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788793163.941206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212160:12345-0@lo:101: 00010000:00010000:0.0:1788793163.941214:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793163.941222:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cd95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941237:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941247:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941254:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5400, rc 0) 00000100:00100000:0.0:1788793163.941282:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212160:12345-0@lo:101: Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.941288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788793163.941318:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212160:0@lo:101: 00010000:00010000:0.0:1788793163.941328:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.941336:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793163.941386:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212288:0@lo:501: 00000100:00100000:0.0:1788793163.941411:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.941430:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.941442:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212288 00000100:00100000:0.0:1788793163.941446:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212288 00000100:00100000:0.0:1788793163.941475:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788793163.941480:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212288:12345-0@lo:501: 00000100:00100000:0.0:1788793163.941620:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212288:12345-0@lo:501: Request processed in 138us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.941627:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788793163.941657:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212288:0@lo:501: 00000100:00100000:0.0:1788793163.941681:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212416:0@lo:503: 00000100:00100000:0.0:1788793163.941718:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.941731:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.941743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212416 00000100:00100000:0.0:1788793163.941747:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212416 00000100:00100000:0.0:1788793163.941766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788793163.941772:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212416:12345-0@lo:503: 00000100:00100000:0.0:1788793163.941906:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212416:12345-0@lo:503: Request processed in 133us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.941913:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788793163.941964:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212416:0@lo:503: 00000040:00080000:0.0:1788793163.942240:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788793163.942295:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212544:0@lo:502: 00000100:00100000:0.0:1788793163.942329:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.942352:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.942367:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212544 00000100:00100000:0.0:1788793163.942371:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212544 00000100:00100000:0.0:1788793163.942392:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788793163.942398:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212544:12345-0@lo:502: 00000100:00100000:0.0:1788793163.942523:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212544:12345-0@lo:502: Request processed in 124us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.942536:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788793163.942574:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212544:0@lo:502: 00000040:00080000:0.0:1788793163.942803:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788793163.942850:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788793163.942897:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788793163.942946:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00010000:00010000:3.0:1788793163.952616:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793163.952631:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.952643:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f5e00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793163.952647:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.952658:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793163.952666:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793163.952672:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793163.952715:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.952722:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793163.952766:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.952775:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9264880f5e00/0xa112893a8a83cd87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa112893a8a83cd8e expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.952793:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.952795:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793163.952797:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793163.952807:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788793163.952828:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461212672:0@lo:103: 00000100:00100000:3.0:1788793163.952902:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793163.953180:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212672 00000100:00100000:0.0:1788793163.953189:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212672 00000100:00100000:0.0:1788793163.953245:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793163.953256:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3310:x1875685461212672:12345-0@lo:103: 00010000:00010000:0.0:1788793163.953270:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788793163.953286:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5200/0xa112893a8a83cd8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa112893a8a83cd87 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793163.953903:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793163.953978:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3310:x1875685461212672:12345-0@lo:103: Request processed in 724us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.953987:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1788793163.954132:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788793163.954211:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788793163.954244:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212800:0@lo:502: 00000100:00100000:0.0:1788793163.954312:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793163.957280:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212800 00000100:00100000:2.0:1788793163.957295:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212800 00000100:00100000:2.0:1788793163.957381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788793163.957393:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212800:12345-0@lo:502: 00000100:00100000:3.0:1788793163.957685:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461212672:0@lo:103: 00000100:00100000:0.0:1788793163.958010:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793163.961320:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212800:12345-0@lo:502: Request processed in 3909us (7001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793163.961545:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788793163.961666:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212800:0@lo:502: 00000040:00080000:2.0:1788793163.961844:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788793163.961859:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788793163.963466:0:7635:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788793163.963476:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788793163.963483:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793163.963486:0:7635:0:(obd_config.c:1547:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788793163.963491:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788793163.963515:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9264b71f8000) 00000020:00000080:3.0:1788793163.963537:0:7635:0:(obd_config.c:716:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788793163.963544:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788793163.963607:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926491114800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788793163.963615:0:7635:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788793163.963622:0:7635:0:(genops.c:1375:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa112893a8a83cdaa 00010000:00010000:3.0:1788793163.976011:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788793163.976403:0:7635:0:(tgt_lastrcvd.c:1869:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788793163.985921:0:7635:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788793163.986248:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788793163.993515:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788793163.994047:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788793163.999336:0:7635:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788793163.999351:0:7635:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793163.999356:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793163.999358:0:7635:0:(obd_config.c:1547:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788793163.999361:0:7635:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793163.999366:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793163.999374:0:7635:0:(obd_config.c:1547:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788793163.999377:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793163.999379:0:7635:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788793163.999437:0:7635:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793163.999441:0:7635:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793163.999442:0:7635:0:(obd_config.c:1547:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788793163.999446:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788793163.999649:0:7625:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788793163.999676:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788793163.999700:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.999711:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793163.999718:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926491114800 from 1 10000000:01000000:3.0:1788793163.999721:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793163.999757:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.999766:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793163.999776:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793163.999810:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212928:0@lo:101: 00000100:00100000:3.0:1788793163.999878:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793163.999917:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ae0a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793164.004277:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461212928 00000100:00100000:0.0:1788793164.004428:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461212928 00000100:00100000:0.0:1788793164.004530:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788793164.004541:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:7625:x1875685461212928:12345-0@lo:101: 00010000:00010000:0.0:1788793164.004558:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793164.004578:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cdb1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.004606:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.004618:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.004626:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5200, rc 0) 00000100:00100000:0.0:1788793164.004708:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461212928:12345-0@lo:101: Request processed in 169us (4829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793164.004714:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788793164.005120:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461212928:0@lo:101: 00010000:00010000:3.0:1788793164.005167:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793164.005177:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793164.005283:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213056:0@lo:501: 00000100:00100000:3.0:1788793164.005409:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.016174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213056 00000100:00100000:1.0:1788793164.016189:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213056 00000100:00100000:1.0:1788793164.016243:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788793164.016253:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213056:12345-0@lo:501: 00000100:00100000:1.0:1788793164.016550:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213056:12345-0@lo:501: Request processed in 297us (11139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.016558:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788793164.016974:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ae0a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793164.017006:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213056:0@lo:501: 00000100:00100000:2.0:1788793164.017055:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213184:0@lo:503: 00000100:00100000:2.0:1788793164.017102:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793164.017128:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488cf2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788793164.017232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213184 00000100:00100000:1.0:1788793164.017237:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213184 00000100:00100000:1.0:1788793164.017262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788793164.017268:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213184:12345-0@lo:503: 00000100:00100000:1.0:1788793164.017600:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213184:12345-0@lo:503: Request processed in 331us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.017608:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788793164.017680:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213184:0@lo:503: 00000040:00080000:2.0:1788793164.017969:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788793164.018029:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213312:0@lo:502: 00000100:00100000:2.0:1788793164.018066:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793164.018101:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491bdf180 going to sleep for 11 seconds 00000100:00100000:0.0:1788793164.018335:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213312 00000100:00100000:0.0:1788793164.018342:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213312 00000100:00100000:0.0:1788793164.018378:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788793164.018386:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213312:12345-0@lo:502: 00000100:00100000:0.0:1788793164.018607:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213312:12345-0@lo:502: Request processed in 221us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793164.018614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788793164.019421:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213312:0@lo:502: 00000040:00080000:3.0:1788793164.019682:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788793164.019736:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788793164.019768:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213440:0@lo:502: 00000100:00100000:3.0:1788793164.019819:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793164.019856:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ae0a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793164.019990:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213440 00000100:00100000:0.0:1788793164.019996:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213440 00000100:00100000:0.0:1788793164.020074:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788793164.020083:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213440:12345-0@lo:502: 00000100:00100000:0.0:1788793164.020268:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213440:12345-0@lo:502: Request processed in 186us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793164.020282:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788793164.020452:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213440:0@lo:502: 00000040:00080000:3.0:1788793164.020541:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788793164.020551:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788793164.024503:0:7639:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793164.024519:0:7639:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793164.024522:0:7639:0:(obd_config.c:1547:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788793164.024529:0:7639:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff926491114800 00000020:00000080:1.0:1788793164.024532:0:7639:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788793164.024554:0:7639:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793164.024557:0:7639:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793164.024559:0:7639:0:(obd_config.c:1547:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788793164.024562:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788793164.030295:0:7625:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788793164.030506:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788793164.030565:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793164.030604:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793164.032324:0:7625:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788793164.032331:0:7625:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff926491114800 10000000:01000000:2.0:1788793164.032336:0:7625:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff926491114800 10000000:01000000:2.0:1788793164.032340:0:7625:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788793164.032346:0:7625:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926491114800 from 1 10000000:01000000:2.0:1788793164.032349:0:7625:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793164.032386:0:7625:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793164.032398:0:7625:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793164.032410:0:7625:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793164.032433:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213568:0@lo:101: 00000100:00100000:2.0:1788793164.032505:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793164.032553:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491bdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793164.032675:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213568 00000100:00100000:3.0:1788793164.032684:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213568 00000100:00100000:3.0:1788793164.032729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788793164.032738:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461213568:12345-0@lo:101: 00010000:00010000:3.0:1788793164.032750:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793164.032767:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cdbf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793164.032788:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793164.032799:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793164.032807:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481504e00, rc 0) 00000100:00100000:3.0:1788793164.032846:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213568:12345-0@lo:101: Request processed in 110us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793164.032852:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788793164.033003:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213568:0@lo:101: 00010000:00010000:0.0:1788793164.033019:0:7625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.033028:0:7625:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793164.033126:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213696:0@lo:501: 00000100:00100000:0.0:1788793164.033181:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793164.033206:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793164.033263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213696 00000100:00100000:3.0:1788793164.033268:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213696 00000100:00100000:3.0:1788793164.033309:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788793164.033316:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213696:12345-0@lo:501: 00000100:00100000:3.0:1788793164.033541:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213696:12345-0@lo:501: Request processed in 224us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793164.033558:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788793164.033773:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213696:0@lo:501: 00000100:00100000:0.0:1788793164.033802:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213824:0@lo:503: 00000100:00100000:0.0:1788793164.033840:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793164.033857:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793164.034240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213824 00000100:00100000:3.0:1788793164.034246:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213824 00000100:00100000:3.0:1788793164.034280:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788793164.034287:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213824:12345-0@lo:503: 00000100:00100000:3.0:1788793164.034612:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213824:12345-0@lo:503: Request processed in 324us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793164.034619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788793164.034705:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213824:0@lo:503: 00000040:00080000:0.0:1788793164.034988:0:7625:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788793164.035063:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213952:0@lo:502: 00000100:00100000:0.0:1788793164.035098:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793164.035130:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793164.036236:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461213952 00000100:00100000:3.0:1788793164.036246:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461213952 00000100:00100000:3.0:1788793164.036293:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788793164.036387:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213952:12345-0@lo:502: 00000100:00100000:3.0:1788793164.036616:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461213952:12345-0@lo:502: Request processed in 234us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793164.036624:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788793164.036758:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461213952:0@lo:502: 00000040:00080000:0.0:1788793164.037039:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788793164.037095:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788793164.037130:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788793164.037223:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788793164.037270:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788793164.037628:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788793164.037671:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788793164.037703:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788793164.037771:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788793164.037806:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788793164.037840:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788793164.037887:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788793164.037922:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788793164.037970:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788793164.038023:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788793164.038056:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788793164.038088:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788793164.038903:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788793164.038993:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788793164.039026:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788793164.039078:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788793164.039113:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788793164.039177:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788793164.039228:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788793164.039263:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788793164.039616:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788793164.039682:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788793164.039715:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788793164.039746:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788793164.039794:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788793164.039830:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788793164.039862:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788793164.039895:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788793164.039944:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788793164.040017:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788793164.040067:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788793164.040102:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788793164.040179:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461214080:0@lo:502: 00000100:00100000:1.0:1788793164.040253:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.040291:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf29af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788793164.040549:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214080 00000100:00100000:3.0:1788793164.040558:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214080 00000100:00100000:3.0:1788793164.040600:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788793164.040609:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461214080:12345-0@lo:502: 00000100:00100000:2.0:1788793164.052061:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461214080:12345-0@lo:502: Request processed in 11443us (11797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.052085:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461214080:0@lo:502: 00000100:00100000:2.0:1788793164.052085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000040:00080000:1.0:1788793164.052266:0:7625:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788793164.052281:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788793164.054408:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788793164.054424:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9264ba76b3d0) 00000020:00000080:2.0:1788793164.054445:0:7640:0:(obd_config.c:716:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788793164.054515:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff926491114800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788793164.054520:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff926491114800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788793164.054523:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff926491114800 3 00010000:00080000:2.0:1788793164.054553:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9264bf3d7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.106@tcp at head 00010000:00010000:2.0:1788793164.056177:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788793164.056371:0:7640:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788793164.056406:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788793164.056417:0:7640:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa112893a8a83cdd4 00000100:00080000:2.0:1788793164.056426:0:7640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793164.056435:0:7640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9264bf3d7000 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788793164.056471:0:7640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9264ba75b100 x1875685461214208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793164.056497:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788793164.056786:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875685461214208:0@lo:38: 00000100:00100000:1.0:1788793164.056856:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.056913:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214208 00000100:00100000:1.0:1788793164.056921:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214208 00000100:00100000:1.0:1788793164.056972:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788793164.056979:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875685461214208:12345-0@lo:38: 00010000:00080000:1.0:1788793164.057011:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1788793164.057038:0:5836:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa112893a8a83cddb 00000004:00100000:1.0:1788793164.057052:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788793164.057079:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9264b1496800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788793164.057127:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875685461214208:12345-0@lo:38: Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.057134:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788793164.057195:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264ba75b100 x1875685461214208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788793174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793164.057207:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788793164.057215:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788793164.057222:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788793164.057227:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788793164.057229:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9264bf3d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788793164.057235:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875685461214208:0@lo:38: 00000040:00080000:3.0:1788793164.059945:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788793164.061688:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461214592:0@lo:400: 00000100:00100000:3.0:1788793164.061754:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793164.064416:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214592 00000100:00100000:2.0:1788793164.064431:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214592 00000100:00100000:2.0:1788793164.064500:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788793164.064510:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461214592:12345-0@lo:400: 00000100:00100000:2.0:1788793164.064604:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461214592:12345-0@lo:400: Request processed in 96us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793164.064612:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788793164.064655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264b71d3800 x1875685461214592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793164.064669:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461214592:0@lo:400: 00000020:01000000:1.0:1788793164.067982:0:7625:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788793164.068022:0:7625:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793164.068048:0:7625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.068061:0:7625:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788793164.068112:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788793164.068115:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788793164.068116:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793164.068117:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793164.068123:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793164.068125:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793164.068126:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788793164.068127:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793164.068129:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793164.068130:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793164.068132:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793164.068135:0:7625:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788793164.068165:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788793164.068167:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788793164.068168:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793164.068169:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793164.068170:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793164.068171:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793164.068172:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788793164.068174:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793164.068175:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793164.068176:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793164.068177:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788793164.068202:0:7625:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788793164.068220:0:7625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461214720:0@lo:253: 00000100:00100000:1.0:1788793164.068289:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.068326:0:7625:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf29a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793164.068348:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875685461214336:0@lo:400: 00000100:00100000:1.0:1788793164.068378:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.068404:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788793164.068411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461214464:0@lo:400: 00000100:00100000:1.0:1788793164.068430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.068462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214336 00000100:00100000:1.0:1788793164.068468:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214336 00000100:00100000:1.0:1788793164.068504:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214464 00000100:00100000:1.0:1788793164.068507:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214464 00000100:00100000:1.0:1788793164.068529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788793164.068537:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875685461214336:12345-0@lo:400: 00000100:00100000:1.0:1788793164.068584:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875685461214336:12345-0@lo:400: Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.068597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788793164.068613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788793164.068619:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461214464:12345-0@lo:400: 00000100:00100000:1.0:1788793164.068648:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461214464:12345-0@lo:400: Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.068654:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788793164.068693:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264b71d2d80 x1875685461214464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793164.068705:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461214464:0@lo:400: 00010000:00080000:1.0:1788793164.068715:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264b71d0e00 x1875685461214336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793164.068723:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875685461214336:0@lo:400: 00000100:00100000:1.0:1788793164.068840:0:7641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1875685461214848:0@lo:901: 00000100:00100000:1.0:1788793164.068869:0:7641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.068902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214848 00000100:00100000:1.0:1788793164.068906:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214848 00000100:00100000:1.0:1788793164.068931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793164.068937:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1875685461214848:12345-0@lo:901: 00000100:00100000:1.0:1788793164.069310:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7641:x1875685461214848:12345-0@lo:901: Request processed in 372us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.069317:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788793164.069336:0:7641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264bf29acc0 going to sleep for 11 seconds 00010000:00080000:1.0:1788793164.069348:0:7641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9264b966d500 x1875685461214848/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788793180 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793164.069370:0:7641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966d500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7641:1875685461214848:0@lo:901: 00000100:00100000:3.0:1788793164.069538:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214720 00000100:00100000:3.0:1788793164.069544:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214720 00000100:00100000:3.0:1788793164.069582:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788793164.069590:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:7625:x1875685461214720:12345-0@lo:253: 20000000:01000000:3.0:1788793164.069622:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788793164.069635:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1788793164.070374:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788793164.070381:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:2.0:1788793164.107853:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788793164.107875:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788793164.107933:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788793164.107938:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788793164.107972:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.107991:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.108001:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.108041:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793164.108055:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 14 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793164.108070:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461214976:0@lo:104: 00000100:00100000:0.0:1788793164.108175:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793164.108210:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff926482f03cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793164.109061:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461214976 00000100:00100000:2.0:1788793164.109071:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461214976 00000100:00100000:2.0:1788793164.109124:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788793164.109134:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461214976:12345-0@lo:104: 00010000:00010000:2.0:1788793164.109180:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793164.109241:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788793164.109248:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:5851:x1875685461214976:12345-0@lo:104: Request processed in 116us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793164.109256:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788793164.109525:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875685461214976:0@lo:104: 00010000:00010000:1.0:1788793164.109546:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109564:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788793164.109570:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109577:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481505800 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1788793164.109582:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109591:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793164.109598:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793164.109604:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793164.109636:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109644:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793164.109662:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109670:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481505800/0xa112893a8a83cd2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd33 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109704:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793164.109706:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793164.109708:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793164.109726:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461215104:0@lo:103: 00000100:00100000:1.0:1788793164.109762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793164.109804:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215104 00000100:00100000:1.0:1788793164.109808:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215104 00010000:00010000:1.0:1788793164.109824:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 15 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793164.109848:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788793164.109855:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926491ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:3311:x1875685461215104:12345-0@lo:103: 00010000:00010000:1.0:1788793164.109866:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793164.109871:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 15 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109882:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 15 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109895:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4600/0xa112893a8a83cd33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cd2c expref: 15 pid: 5829 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109908:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109917:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788793164.109931:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006978138s 00010000:00010000:1.0:1788793164.109942:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109965:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109972:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109979:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109984:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f5e00 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:1.0:1788793164.109988:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.109995:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.110008:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.110018:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793164.110049:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926491ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3311:x1875685461215104:12345-0@lo:103: Request processed in 194us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793164.110055:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788793164.110100:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.110108:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793164.110124:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5e00/0xa112893a8a83cde2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793164.110183:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461215104:0@lo:103: 00000100:00100000:0.0:1788793164.118132:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:7625:x1875685461214720:12345-0@lo:253: Request processed in 48533us (49832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793164.118171:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788793164.118286:0:7625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:7625:1875685461214720:0@lo:253: 10000000:01000000:1.0:1788793164.118301:0:7625:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788793164.118305:0:7625:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788793164.118307:0:7625:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788793164.118308:0:7625:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788793164.118310:0:7625:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788793164.118311:0:7625:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788793164.118312:0:7625:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788793164.118314:0:7625:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788793164.118315:0:7625:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788793164.118317:0:7625:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788793164.118318:0:7625:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788793164.118320:0:7625:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788793164.118350:0:7625:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788793164.126451:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788793164.126640:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788793164.126898:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788793164.127115:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788793164.127913:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788793164.128320:0:7625:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788793164.129559:0:7625:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788793164.305222:0:7625:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788793164.305230:0:7625:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788793164.305263:0:7625:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788793164.305434:0:7625:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788793164.305449:0:7625:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788793164.305477:0:7625:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788793164.438743:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793165.072605:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461215232:0@lo:13: 00000100:00100000:2.0:1788793165.072678:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793165.072753:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215232 00000100:00100000:2.0:1788793165.072761:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215232 00000100:00100000:2.0:1788793165.072806:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788793165.072816:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461215232:12345-0@lo:13: 00002000:00000024:2.0:1788793165.073810:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788793165.073900:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba758e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461215232:12345-0@lo:13: Request processed in 1083us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793165.073928:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788793165.074736:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba75b100 x1875685461215232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793165.074760:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461215232:0@lo:13: 00010000:00010000:0.0:1788793165.457395:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793166.480352:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793167.504424:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793168.535101:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793169.168302:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461215360:0@lo:400: 00000100:00100000:3.0:1788793169.168378:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793169.168424:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461215872:0@lo:400: 00000100:00100000:3.0:1788793169.168452:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793169.168473:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793169.168478:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461215744:0@lo:400: 00000100:00100000:3.0:1788793169.168497:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793169.168527:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215360 00000100:00100000:3.0:1788793169.168535:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215360 00000100:00100000:3.0:1788793169.168575:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788793169.168584:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461215360:12345-0@lo:400: 00000100:00100000:3.0:1788793169.168636:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3309:x1875685461215360:12345-0@lo:400: Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793169.168642:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788793169.168671:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215744 00000100:00100000:3.0:1788793169.168675:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215744 00000100:00100000:3.0:1788793169.168709:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788793169.168714:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461215744:12345-0@lo:400: 00000100:00100000:3.0:1788793169.168745:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461215744:12345-0@lo:400: Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793169.168751:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788793169.168765:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793169.168792:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d3b80 x1875685461215744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793169.168820:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461215744:0@lo:400: 00000100:00100000:3.0:1788793169.168832:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461215360:0@lo:400: 00000100:00100000:1.0:1788793169.168932:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461215488:0@lo:400: 00000100:00100000:1.0:1788793169.168961:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793169.168981:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788793169.168987:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461215616:0@lo:400: 00000100:00100000:1.0:1788793169.169016:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793169.169046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215872 00000100:00100000:1.0:1788793169.169050:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215872 00000100:00100000:1.0:1788793169.169075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215488 00000100:00100000:1.0:1788793169.169079:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215488 00000100:00100000:1.0:1788793169.169089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461215616 00000100:00100000:1.0:1788793169.169091:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461215616 00000100:00100000:1.0:1788793169.169104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788793169.169110:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461215872:12345-0@lo:400: 00000100:00100000:1.0:1788793169.169163:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461215872:12345-0@lo:400: Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793169.169169:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788793169.169184:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788793169.169190:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461215488:12345-0@lo:400: 00000100:00100000:1.0:1788793169.169220:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461215488:12345-0@lo:400: Request processed in 31us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793169.169226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788793169.169236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788793169.169241:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461215616:12345-0@lo:400: 00000100:00100000:1.0:1788793169.169266:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461215616:12345-0@lo:400: Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793169.169271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788793169.169302:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d0a80 x1875685461215616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793169.169311:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461215616:0@lo:400: 00010000:00080000:1.0:1788793169.169319:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d1180 x1875685461215488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793169.169337:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461215488:0@lo:400: 00000100:00080000:3.0:1788793169.169440:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788793169.169457:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d1880 x1875685461215872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793169.169465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461215872:0@lo:400: 00010000:00010000:2.0:1788793169.552647:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793170.195941:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461216000:0@lo:13: 00000100:00100000:1.0:1788793170.196006:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793170.196159:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216000 00000100:00100000:1.0:1788793170.196166:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216000 00000100:00100000:1.0:1788793170.196210:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788793170.196219:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461216000:12345-0@lo:13: 00002000:00000024:1.0:1788793170.196252:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793170.196296:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461216000:12345-0@lo:13: Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793170.196303:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788793170.196340:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d1880 x1875685461216000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793170.196358:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461216000:0@lo:13: 00000001:02000400:1.0:1788793170.383587:0:7983:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788793170.582933:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793171.603283:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793172.628717:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793173.650109:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788793173.776477:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788793173.776490:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9264b9db6800 from 30 10000000:01000000:1.0:1788793173.776497:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788793173.776574:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.776590:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.776629:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.776663:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216128:0@lo:101: 00000100:00100000:1.0:1788793173.776769:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.776855:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.776905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216128 00000100:00100000:0.0:1788793173.776921:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216128 00000100:00100000:0.0:1788793173.777055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788793173.777066:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461216128:12345-0@lo:101: 00010000:00010000:0.0:1788793173.777084:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793173.777114:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cde9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.777189:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.777201:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.777211:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4c00, rc 0) 00000100:00100000:0.0:1788793173.777301:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216128:12345-0@lo:101: Request processed in 237us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.777307:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788793173.777725:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216128:0@lo:101: 00010000:00010000:1.0:1788793173.777751:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.777763:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.779001:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216256:0@lo:501: 00000100:00100000:1.0:1788793173.779074:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.782310:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.787600:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216256 00000100:00100000:3.0:1788793173.787616:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216256 00000100:00100000:3.0:1788793173.787880:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788793173.787893:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216256:12345-0@lo:501: 00000100:00100000:3.0:1788793173.788335:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216256:12345-0@lo:501: Request processed in 444us (9258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793173.788348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788793173.788416:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216256:0@lo:501: 00000100:00100000:1.0:1788793173.788510:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216384:0@lo:503: 00000100:00100000:1.0:1788793173.788594:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.788648:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.788788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216384 00000100:00100000:2.0:1788793173.788796:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216384 00000100:00100000:2.0:1788793173.788851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788793173.788860:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216384:12345-0@lo:503: 00000100:00100000:2.0:1788793173.789277:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216384:12345-0@lo:503: Request processed in 416us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.789286:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788793173.789467:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216384:0@lo:503: 00000100:00100000:3.0:1788793173.790302:0:8088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8088:1875685461216512:0@lo:502: 00000100:00100000:3.0:1788793173.790377:0:8088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.790419:0:8088:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.790470:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216512 00000100:00100000:2.0:1788793173.790480:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216512 00000100:00100000:2.0:1788793173.790528:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788793173.790537:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8088:x1875685461216512:12345-0@lo:502: 00000100:00100000:2.0:1788793173.790977:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8088:x1875685461216512:12345-0@lo:502: Request processed in 438us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.790986:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788793173.791621:0:8088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8088:1875685461216512:0@lo:502: 00000100:00100000:3.0:1788793173.791939:0:8088:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8088:1875685461216640:0@lo:502: 00000100:00100000:3.0:1788793173.791996:0:8088:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.792111:0:8088:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.794618:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216640 00000100:00100000:0.0:1788793173.794634:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216640 00000100:00100000:2.0:1788793173.794965:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788793173.794981:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8088:x1875685461216640:12345-0@lo:502: 00000100:00100000:2.0:1788793173.795303:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8088:x1875685461216640:12345-0@lo:502: Request processed in 328us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.795311:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788793173.795695:0:8088:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8088:1875685461216640:0@lo:502: 00000040:00080000:3.0:1788793173.795738:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788793173.795929:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788793173.795964:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793173.795977:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.796012:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793173.796024:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788793173.796027:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788793173.796031:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788793173.796074:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.796082:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.796093:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.796118:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216768:0@lo:101: 00000100:00100000:1.0:1788793173.796219:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.796280:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.796305:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216768 00000100:00100000:2.0:1788793173.796315:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216768 00000100:00100000:2.0:1788793173.796365:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788793173.796375:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461216768:12345-0@lo:101: 00010000:00010000:2.0:1788793173.796397:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793173.796417:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cdf7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.796459:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.796649:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.796659:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481637c00, rc 0) 00000100:00100000:2.0:1788793173.796717:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461216768:12345-0@lo:101: Request processed in 344us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.796724:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788793173.796775:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216768:0@lo:101: 00010000:00010000:1.0:1788793173.796813:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.796825:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.796887:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216896:0@lo:501: 00000100:00100000:1.0:1788793173.796921:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.796956:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.796982:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461216896 00000100:00100000:2.0:1788793173.796990:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461216896 00000100:00100000:2.0:1788793173.797012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788793173.797019:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461216896:12345-0@lo:501: 00000100:00100000:2.0:1788793173.797381:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461216896:12345-0@lo:501: Request processed in 361us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.797387:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788793173.797442:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461216896:0@lo:501: 00000100:00100000:1.0:1788793173.797476:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217024:0@lo:503: 00000100:00100000:1.0:1788793173.797527:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.797562:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.797684:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217024 00000100:00100000:3.0:1788793173.797690:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217024 00000100:00100000:3.0:1788793173.797724:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788793173.797736:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461217024:12345-0@lo:503: 00000100:00100000:2.0:1788793173.798255:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461217024:12345-0@lo:503: Request processed in 519us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.798274:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788793173.798533:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217024:0@lo:503: 00000100:00100000:1.0:1788793173.799081:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8089:1875685461217152:0@lo:502: 00000100:00100000:1.0:1788793173.799135:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.799329:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.801648:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217152 00000100:00100000:3.0:1788793173.801666:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217152 00000100:00100000:2.0:1788793173.801992:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788793173.802006:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8089:x1875685461217152:12345-0@lo:502: 00000100:00100000:2.0:1788793173.802701:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8089:x1875685461217152:12345-0@lo:502: Request processed in 694us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.802723:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788793173.803093:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8089:1875685461217152:0@lo:502: 00000020:01000000:1.0:1788793173.803278:0:8089:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793173.803292:0:8089:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793173.803295:0:8089:0:(obd_config.c:1547:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788793173.803301:0:8089:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788793173.803303:0:8089:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788793173.803343:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8089:1875685461217280:0@lo:502: 00000100:00100000:1.0:1788793173.803401:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.803555:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.803616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217280 00000100:00100000:2.0:1788793173.803625:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217280 00000100:00100000:2.0:1788793173.803673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788793173.803682:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8089:x1875685461217280:12345-0@lo:502: 00000100:00100000:2.0:1788793173.803894:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8089:x1875685461217280:12345-0@lo:502: Request processed in 212us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.803902:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788793173.804039:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8089:1875685461217280:0@lo:502: 00000020:01000000:1.0:1788793173.804061:0:8089:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793173.804066:0:8089:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793173.804067:0:8089:0:(obd_config.c:1547:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788793173.804072:0:8089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788793173.804767:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788793173.804814:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788793173.804827:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.804842:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793173.804855:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793173.804857:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926488cd7800 from 30 10000000:01000000:2.0:1788793173.804861:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793173.804904:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.804914:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.804924:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793173.804948:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217408:0@lo:101: 00000100:00100000:2.0:1788793173.805012:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793173.805308:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264947b1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.805436:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217408 00000100:00100000:3.0:1788793173.805445:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217408 00000100:00100000:3.0:1788793173.805490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788793173.805500:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461217408:12345-0@lo:101: 00010000:00010000:3.0:1788793173.805514:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793173.805530:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ce05 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.805557:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.805570:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.805579:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481505a00, rc 0) 00000100:00100000:3.0:1788793173.805635:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461217408:12345-0@lo:101: Request processed in 136us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793173.805642:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788793173.805774:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217408:0@lo:101: 00010000:00010000:1.0:1788793173.805809:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.805831:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.805890:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217536:0@lo:501: 00000100:00100000:1.0:1788793173.805923:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.805950:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.806031:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217536 00000100:00100000:3.0:1788793173.806036:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217536 00000100:00100000:3.0:1788793173.806053:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788793173.806058:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461217536:12345-0@lo:501: 00000100:00100000:3.0:1788793173.806544:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461217536:12345-0@lo:501: Request processed in 483us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793173.806559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788793173.806628:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217536:0@lo:501: 00000100:00100000:1.0:1788793173.806660:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217664:0@lo:503: 00000100:00100000:1.0:1788793173.806702:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.806731:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.807933:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217664 00000100:00100000:2.0:1788793173.807947:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217664 00000100:00100000:2.0:1788793173.808000:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788793173.808011:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461217664:12345-0@lo:503: 00000100:00100000:2.0:1788793173.808711:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461217664:12345-0@lo:503: Request processed in 698us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.808721:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788793173.808925:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461217664:0@lo:503: 00000100:00100000:3.0:1788793173.812121:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8090:1875685461217792:0@lo:502: 00000100:00100000:3.0:1788793173.812282:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.812328:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.812545:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217792 00000100:00100000:2.0:1788793173.812556:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217792 00000100:00100000:2.0:1788793173.812616:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788793173.812627:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8090:x1875685461217792:12345-0@lo:502: 00000100:00100000:2.0:1788793173.813815:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8090:x1875685461217792:12345-0@lo:502: Request processed in 1175us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.813828:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788793173.815406:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8090:1875685461217792:0@lo:502: 00000100:00100000:1.0:1788793173.815532:0:8090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8090:1875685461217920:0@lo:502: 00000100:00100000:1.0:1788793173.815615:0:8090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.815667:0:8090:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.815773:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461217920 00000100:00100000:3.0:1788793173.815790:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461217920 00000100:00100000:3.0:1788793173.815858:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788793173.815869:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8090:x1875685461217920:12345-0@lo:502: 00000100:00100000:3.0:1788793173.816189:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8090:x1875685461217920:12345-0@lo:502: Request processed in 322us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793173.816198:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788793173.816892:0:8090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8090:1875685461217920:0@lo:502: 00000040:00080000:1.0:1788793173.816930:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788793173.817136:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788793173.817192:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793173.817205:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.817219:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793173.817231:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788793173.817235:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff926488cd7800 from 5 10000000:01000000:2.0:1788793173.817239:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788793173.817283:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.817304:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.817316:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793173.817338:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218048:0@lo:101: 00000100:00100000:2.0:1788793173.817390:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793173.817553:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264c1a9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.818882:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218048 00000100:00100000:0.0:1788793173.818907:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218048 00000100:00100000:1.0:1788793173.819067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788793173.819079:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461218048:12345-0@lo:101: 00010000:00010000:1.0:1788793173.819098:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793173.819123:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a11800/0xa112893a8a83ce1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ce13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.819180:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a11800/0xa112893a8a83ce1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ce13 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.819209:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a11800/0xa112893a8a83ce1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce13 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.819220:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a11800, rc 0) 00000100:00100000:1.0:1788793173.819303:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461218048:12345-0@lo:101: Request processed in 226us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793173.819309:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788793173.819996:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218048:0@lo:101: 00010000:00010000:2.0:1788793173.820024:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.820038:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ce1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793173.820120:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218176:0@lo:256: 00000100:00100000:2.0:1788793173.820213:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793173.820304:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264c1a9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.820883:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218176 00000100:00100000:0.0:1788793173.820893:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218176 00000100:00100000:1.0:1788793173.824066:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788793173.824085:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461218176:12345-0@lo:256: 20000000:01000000:1.0:1788793173.824123:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788793173.824189:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788793173.824194:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788793173.824376:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461218176:12345-0@lo:256: Request processed in 296us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793173.824386:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788793173.824603:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218176:0@lo:256: 10000000:01000000:3.0:1788793173.824675:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788793173.824688:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.824703:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481637a00/0xa112893a8a83ce13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793173.824715:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788793173.824719:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788793173.824723:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788793173.824766:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.824788:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.824823:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793173.824848:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218304:0@lo:101: 00000100:00100000:3.0:1788793173.824892:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.824931:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.825127:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218304 00000100:00100000:0.0:1788793173.825171:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218304 00000100:00100000:0.0:1788793173.825212:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788793173.825220:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461218304:12345-0@lo:101: 00010000:00010000:0.0:1788793173.825231:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793173.825247:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ce21 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.825272:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.825285:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793173.825295:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4a00, rc 0) 00000100:00100000:0.0:1788793173.825332:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461218304:12345-0@lo:101: Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.825339:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788793173.825551:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218304:0@lo:101: 00010000:00010000:3.0:1788793173.825567:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793173.825578:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793173.825635:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218432:0@lo:501: 00000100:00100000:3.0:1788793173.825662:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.825680:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793173.825773:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218432 00000100:00100000:1.0:1788793173.825789:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218432 00000100:00100000:1.0:1788793173.825819:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788793173.825826:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461218432:12345-0@lo:501: 00000100:00100000:1.0:1788793173.826160:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461218432:12345-0@lo:501: Request processed in 312us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793173.826168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788793173.826373:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218432:0@lo:501: 00000100:00100000:3.0:1788793173.826403:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218560:0@lo:503: 00000100:00100000:3.0:1788793173.826520:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.826550:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.826639:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218560 00000100:00100000:2.0:1788793173.826645:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218560 00000100:00100000:2.0:1788793173.826672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788793173.826680:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461218560:12345-0@lo:503: 00000100:00100000:2.0:1788793173.827051:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461218560:12345-0@lo:503: Request processed in 371us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.827059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788793173.827298:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461218560:0@lo:503: 00000100:00100000:3.0:1788793173.828677:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8091:1875685461218688:0@lo:502: 00000100:00100000:3.0:1788793173.828763:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793173.828829:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ba72b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.828942:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218688 00000100:00100000:2.0:1788793173.828950:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218688 00000100:00100000:2.0:1788793173.829007:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788793173.829017:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8091:x1875685461218688:12345-0@lo:502: 00000100:00100000:2.0:1788793173.829444:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8091:x1875685461218688:12345-0@lo:502: Request processed in 415us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.829452:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788793173.829677:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8091:1875685461218688:0@lo:502: 00000020:01000000:3.0:1788793173.829721:0:8091:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788793173.829730:0:8091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788793173.829739:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793173.829742:0:8091:0:(obd_config.c:1547:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788793173.829746:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788793173.829750:0:8091:0:(obd_config.c:1471:class_process_config()) adding mapping from uuid 192.168.201.106@tcp to nid 0x20000c0a8c96a (192.168.201.106@tcp) 00000020:01000000:3.0:1788793173.829789:0:8091:0:(obd_config.c:1958:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788793173.829794:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788793173.829820:0:8091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9264b71f99e8) 00000020:00000080:3.0:1788793173.829846:0:8091:0:(obd_config.c:716:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788793173.829852:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788793173.829934:0:8091:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788793173.829941:0:8091:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788793173.829949:0:8091:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa112893a8a83ce36 00010000:00080000:3.0:1788793173.830003:0:8091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9264bf306800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.106@tcp at head 00010000:00010000:3.0:1788793173.830351:0:8091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788793173.830991:0:8091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788793173.831010:0:8091:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788793173.836320:0:8091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793173.837014:0:8091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788793173.837080:0:8091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788793173.837296:0:8091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788793173.841181:0:8092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788793173.841195:0:8092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788793173.842671:0:8091:0:(obd_config.c:813:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788793173.842687:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788793173.842736:0:8091:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788793173.842768:0:8091:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa112893a8a83ce3d 00000100:00080000:2.0:1788793173.842793:0:8091:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788793173.842819:0:8091:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9264bf306800 using connection 192.168.201.106@tcp/0@lo 00000100:00100000:2.0:1788793173.842872:0:8091:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9264ba759180 x1875685461218816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788793173.842901:0:8091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788793173.842978:0:8091:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793173.842982:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793173.842984:0:8091:0:(obd_config.c:1547:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788793173.842987:0:8091:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793173.842992:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793173.842993:0:8091:0:(obd_config.c:1547:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788793173.842996:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788793173.842998:0:8091:0:(obd_config.c:1521:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788793173.843030:0:8091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8091:1875685461218944:0@lo:502: 00000100:00100000:2.0:1788793173.843135:0:8091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793173.843229:0:8091:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264c1a9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788793173.843511:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875685461218816:0@lo:8: 00000100:00100000:1.0:1788793173.843576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.843766:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461219456:0@lo:400: 00000100:00100000:0.0:1788793173.843826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.843852:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793173.843858:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461219072:0@lo:400: 00000100:00100000:0.0:1788793173.843881:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.843907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461219200:0@lo:400: 00000100:00100000:0.0:1788793173.843956:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.843978:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788793173.843984:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461219328:0@lo:400: 00000100:00100000:0.0:1788793173.844007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.844044:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219456 00000100:00100000:0.0:1788793173.844052:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219456 00000100:00100000:0.0:1788793173.844107:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219072 00000100:00100000:0.0:1788793173.844111:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219072 00000100:00100000:0.0:1788793173.844125:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219200 00000100:00100000:0.0:1788793173.844128:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219200 00000100:00100000:0.0:1788793173.844177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793173.844189:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461219456:12345-0@lo:400: 00000100:00100000:0.0:1788793173.844251:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461219456:12345-0@lo:400: Request processed in 63us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.844259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788793173.844281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788793173.844287:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461219072:12345-0@lo:400: 00000100:00100000:0.0:1788793173.844314:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461219072:12345-0@lo:400: Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.844320:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788793173.844331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788793173.844338:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461219200:12345-0@lo:400: 00000100:00100000:0.0:1788793173.844368:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461219200:12345-0@lo:400: Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.844374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788793173.844403:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218816 00000100:00100000:0.0:1788793173.844406:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218816 00000100:00100000:0.0:1788793173.844426:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219328 00000100:00100000:0.0:1788793173.844450:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219328 00000100:00100000:0.0:1788793173.844474:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793173.844481:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461219328:12345-0@lo:400: 00000100:00100000:0.0:1788793173.844514:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461219328:12345-0@lo:400: Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.844520:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793173.844532:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788793173.844536:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875685461218816:12345-0@lo:8: 00010000:00080000:0.0:1788793173.844563:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788793173.844594:0:6687:0:(genops.c:1375:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa112893a8a83ce44 00002000:00100000:0.0:1788793173.844611:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9264ba559000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788793173.844616:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788793173.844621:0:6687:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788793173.844788:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788793173.844977:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788793173.845010:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9264ba55f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788793173.845057:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875685461218816:12345-0@lo:8: Request processed in 519us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.845064:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788793173.845085:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788793173.845091:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788793173.845133:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba759180 x1875685461218816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788793183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793173.845170:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788793173.845180:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788793173.845190:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788793173.845196:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788793173.845206:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9264bf306800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788793173.845220:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788793173.845226:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875685461218816:0@lo:8: 00010000:00080000:0.0:1788793173.845265:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113f800 x1875685461219328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793173.845274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461219328:0@lo:400: 00010000:00080000:0.0:1788793173.845285:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113c700 x1875685461219200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793173.845293:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461219200:0@lo:400: 00010000:00080000:0.0:1788793173.845319:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113d500 x1875685461219072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793173.845328:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461219072:0@lo:400: 00010000:00080000:0.0:1788793173.845338:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113e300 x1875685461219456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788793189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793173.845345:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461219456:0@lo:400: 00000100:00100000:0.0:1788793173.845369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461218944 00000100:00100000:0.0:1788793173.845375:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461218944 00000100:00100000:0.0:1788793173.845406:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788793173.845413:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8091:x1875685461218944:12345-0@lo:502: 00000100:00100000:0.0:1788793173.845677:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8091:x1875685461218944:12345-0@lo:502: Request processed in 263us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.845685:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000004:00080000:1.0:1788793173.845988:0:8092:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788793173.846115:0:8092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194085973973ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788793173.846766:0:8091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8091:1875685461218944:0@lo:502: 00000020:01000000:2.0:1788793173.846900:0:8091:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793173.846909:0:8091:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793173.846912:0:8091:0:(obd_config.c:1547:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788793173.846917:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788793173.852945:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788793173.852994:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788793173.853009:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.853026:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793173.853056:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788793173.853060:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff926488538000 from 1 10000000:01000000:1.0:1788793173.853064:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788793173.853123:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.853133:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.853163:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.853193:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461219584:0@lo:101: 00000100:00100000:1.0:1788793173.853299:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.853357:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788793173.855504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219584 00000100:00100000:2.0:1788793173.855523:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219584 00000100:00100000:2.0:1788793173.855599:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788793173.855611:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461219584:12345-0@lo:101: 00010000:00010000:2.0:1788793173.855632:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793173.855654:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ce4b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.855693:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.855707:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793173.855719:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481637200, rc 0) 00000100:00100000:2.0:1788793173.855835:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461219584:12345-0@lo:101: Request processed in 227us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793173.855842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788793173.859055:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461219584:0@lo:101: 00010000:00010000:1.0:1788793173.859104:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.859123:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793173.859787:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461219712:0@lo:501: 00000100:00100000:1.0:1788793173.859881:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.859930:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219712 00000100:00100000:1.0:1788793173.859939:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219712 00000100:00100000:1.0:1788793173.859992:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788793173.860003:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461219712:12345-0@lo:501: 00000100:00100000:1.0:1788793173.860303:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461219712:12345-0@lo:501: Request processed in 299us (420us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788793173.860311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788793173.861486:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788793173.861526:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461219712:0@lo:501: 10000000:01000000:1.0:1788793173.861578:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788793173.861592:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793173.861607:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788793173.975552:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788793173.975677:0:8093:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788793173.975704:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461219968:0@lo:7: 00000100:00100000:1.0:1788793173.975767:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.975825:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788793173.975843:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788793173.976032:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461219840:0@lo:13: 00000100:00100000:1.0:1788793173.976058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.976179:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219840 00000100:00100000:0.0:1788793173.976192:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219840 00000100:00100000:0.0:1788793173.976239:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788793173.976246:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875685461219840:12345-0@lo:13: 00002000:00000024:0.0:1788793173.976285:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788793173.981772:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875685461219840:12345-0@lo:13: Request processed in 5515us (5702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.981798:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788793173.981861:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788793173.982341:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b966ea00 x1875685461219840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793173.982367:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461219840:0@lo:13: 00000100:00100000:1.0:1788793173.982405:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461219968 00000100:00100000:1.0:1788793173.982412:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461219968 00000100:00100000:1.0:1788793173.982447:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788793173.982453:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8093:x1875685461219968:12345-0@lo:7: 00002000:00080000:0.0:1788793173.990961:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788793173.990970:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788793173.991381:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8093:x1875685461219968:12345-0@lo:7: Request processed in 8922us (15609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793173.991394:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788793173.991532:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b966c000 x1875685461219968/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788793189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793173.991546:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461219968:0@lo:7: 00000004:00080000:1.0:1788793173.991559:0:8093:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788793173.991595:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220096:0@lo:5: 00000100:00100000:1.0:1788793173.991634:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.991736:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788793173.991836:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220096 00000100:00100000:3.0:1788793173.991843:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220096 00000100:00100000:3.0:1788793173.991990:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793173.992000:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8093:x1875685461220096:12345-0@lo:5: 00002000:00080000:3.0:1788793173.992027:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788793173.992031:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788793173.992479:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8093:x1875685461220096:12345-0@lo:5: Request processed in 479us (843us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788793173.992487:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788793173.992627:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b966c000 x1875685461220096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793173.992639:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220096:0@lo:5: 00000004:00080000:1.0:1788793173.992648:0:8093:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788793173.992676:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220224:0@lo:700: 00000100:00100000:1.0:1788793173.992702:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793173.992759:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788793173.992827:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220224 00000100:00100000:0.0:1788793173.992833:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220224 00000100:00100000:0.0:1788793173.993036:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788793173.993045:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8093:x1875685461220224:12345-0@lo:700: 00000100:00100000:0.0:1788793173.993075:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875685461220352:0@lo:700: 00000100:00100000:0.0:1788793173.993113:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793173.993173:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264b15a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788793173.993392:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220352 00000100:00100000:1.0:1788793173.993398:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220352 00000100:00100000:1.0:1788793173.993435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788793173.993442:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875685461220352:12345-0@lo:700: 40000000:02000000:1.0:1788793174.065428:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788793174.075887:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875685461220352:12345-0@lo:700: Request processed in 82436us (82763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793174.075903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788793174.076418:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113e300 x1875685461220352/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788793189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793174.076434:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875685461220352:0@lo:700: 40000000:02000000:0.0:1788793174.076446:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1788793174.268490:0:7644:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788793174.268519:0:7644:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788793174.269034:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8093:x1875685461220224:12345-0@lo:700: Request processed in 275985us (276325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793174.269047:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788793174.271429:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b966f480 x1875685461220224/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788793189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793174.271467:0:8093:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788793174.271486:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220224:0@lo:700: 00000004:02000040:3.0:1788793174.325912:0:8093:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788793174.337044:0:8093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b966fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220480:0@lo:5: 00000100:00100000:1.0:1788793174.337117:0:8093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793174.337244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220480 00000100:00100000:0.0:1788793174.337252:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220480 00000100:00100000:0.0:1788793174.337299:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788793174.337308:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8093:x1875685461220480:12345-0@lo:5: 00000100:00100000:1.0:1788793174.341344:0:8093:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2a80 going to sleep for 11 seconds 00002000:00080000:0.0:1788793174.351572:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788793174.351593:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788793174.356437:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8093:x1875685461220480:12345-0@lo:5: Request processed in 19123us (19312us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788793174.356452:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788793174.356891:0:8093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b966fb80 x1875685461220480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788793190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793174.356911:0:8093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b966fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8093:1875685461220480:0@lo:5: 00000004:00080000:2.0:1788793174.356936:0:8093:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788793174.672909:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793175.312505:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461220608:0@lo:13: 00000100:00100000:0.0:1788793175.312587:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793175.312766:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220608 00000100:00100000:3.0:1788793175.312774:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220608 00000100:00100000:3.0:1788793175.312845:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788793175.312854:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461220608:12345-0@lo:13: 00002000:00000024:3.0:1788793175.312888:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793175.312933:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461220608:12345-0@lo:13: Request processed in 80us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793175.312940:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788793175.313052:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788793175.313082:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d3b80 x1875685461220608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793175.313100:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461220608:0@lo:13: 00010000:00010000:3.0:1788793175.700412:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788793176.519790:0:7644:0:(tgt_lastrcvd.c:981:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788793176.721489:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793176.913076:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793176.913127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442322560 00000100:00100000:3.0:1788793176.913168:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442322560 00000100:00100000:3.0:1788793176.913207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:3.0:1788793176.913214:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2364:x1875685442322560:12345-192.168.201.6@tcp:250: 00010000:00080000:3.0:1788793176.913237:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 175113f2-5ecd-47e7-965d-37390a6514ab@192.168.201.6@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1788793176.913277:0:5830:0:(genops.c:1375:class_connect()) connect: client 175113f2-5ecd-47e7-965d-37390a6514ab, cookie 0xa112893a8a83ce59 00000100:00080000:3.0:1788793176.913576:0:5830:0:(import.c:65:import_set_state_nolock()) ffff9264bf300000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793176.913636:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+5:2364:x1875685442322560:12345-192.168.201.6@tcp:250: Request processed in 421us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793176.913643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 112 00000100:00100000:0.0:1788793176.930561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793176.930590:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442322688 00000100:00100000:0.0:1788793176.930598:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442322688 00000100:00100000:0.0:1788793176.930632:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:0.0:1788793176.930638:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+5:5594:x1875685442322688:12345-192.168.201.6@tcp:101: 00010000:00010000:0.0:1788793176.930652:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793176.930666:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d11 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793176.930687:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793176.930695:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793176.930714:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5800, rc 0) 00000100:00100000:0.0:1788793176.930777:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+6:5594:x1875685442322688:12345-192.168.201.6@tcp:101: Request processed in 137us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793176.930783:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 113 00000100:00100000:2.0:1788793176.939697:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793176.939789:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442322816 00000100:00100000:1.0:1788793176.939799:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442322816 00000100:00100000:1.0:1788793176.939851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:1.0:1788793176.939861:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+6:5594:x1875685442322816:12345-192.168.201.6@tcp:501: 00000100:00100000:1.0:1788793176.940235:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+6:5594:x1875685442322816:12345-192.168.201.6@tcp:501: Request processed in 374us (548us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788793176.940244:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 114 00000100:00100000:0.0:1788793176.942318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793176.942395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442322944 00000100:00100000:3.0:1788793176.942418:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442322944 00000100:00100000:3.0:1788793176.942485:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:3.0:1788793176.942497:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+6:5594:x1875685442322944:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788793176.942516:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793176.942540:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d18 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793176.942574:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793176.942587:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793176.942597:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481505000, rc 0) 00000100:00100000:3.0:1788793176.942660:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+7:5594:x1875685442322944:12345-192.168.201.6@tcp:101: Request processed in 166us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793176.942665:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 115 00000100:00100000:0.0:1788793176.951056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793176.951125:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323072 00000100:00100000:0.0:1788793176.951182:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323072 00000100:00100000:0.0:1788793176.951265:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:0.0:1788793176.951280:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+7:5594:x1875685442323072:12345-192.168.201.6@tcp:501: 00000100:00100000:0.0:1788793176.951675:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+8:5594:x1875685442323072:12345-192.168.201.6@tcp:501: Request processed in 398us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793176.951685:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 116 00000100:00100000:2.0:1788793176.953598:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793176.953675:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323200 00000100:00100000:3.0:1788793176.953689:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323200 00000100:00100000:3.0:1788793176.953755:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788793176.953770:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+8:5594:x1875685442323200:12345-192.168.201.6@tcp:503: 00000100:00100000:3.0:1788793176.954193:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+8:5594:x1875685442323200:12345-192.168.201.6@tcp:503: Request processed in 428us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793176.954200:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 117 00000100:00100000:3.0:1788793176.956257:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793176.958127:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323328 00000100:00100000:2.0:1788793176.958183:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323328 00000100:00100000:2.0:1788793176.958278:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:2.0:1788793176.958289:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+8:5613:x1875685442323328:12345-192.168.201.6@tcp:502: 00000100:00100000:2.0:1788793176.958659:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+8:5613:x1875685442323328:12345-192.168.201.6@tcp:502: Request processed in 370us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793176.958668:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 118 00000100:00100000:0.0:1788793176.984902:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793176.985321:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323456 00000100:00100000:3.0:1788793176.985338:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323456 00000100:00100000:3.0:1788793176.985408:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:3.0:1788793176.985440:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+8:5613:x1875685442323456:12345-192.168.201.6@tcp:502: 00000100:00100000:3.0:1788793176.985810:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+8:5613:x1875685442323456:12345-192.168.201.6@tcp:502: Request processed in 372us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793176.985819:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 119 00000100:00100000:1.0:1788793176.990210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793176.990264:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323584 00000100:00100000:1.0:1788793176.990276:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323584 00000100:00100000:1.0:1788793176.990334:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:1.0:1788793176.990345:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+8:5594:x1875685442323584:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788793176.990366:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793176.990386:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a10e00/0xa112893a8a83ce6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d42 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793176.990420:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a10e00/0xa112893a8a83ce6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d42 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793176.990431:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a10e00/0xa112893a8a83ce6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d42 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793176.990449:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a10e00, rc 0) 00000100:00100000:1.0:1788793176.990510:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+9:5594:x1875685442323584:12345-192.168.201.6@tcp:101: Request processed in 167us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793176.990517:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 120 00000100:00100000:2.0:1788793176.997897:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793176.998604:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323712 00000100:00100000:1.0:1788793176.998619:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323712 00000100:00100000:1.0:1788793176.998680:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:1.0:1788793176.998688:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+9:5594:x1875685442323712:12345-192.168.201.6@tcp:256: 20000000:01000000:1.0:1788793176.998717:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788793176.998756:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788793176.998761:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788793176.998765:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788793176.998767:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788793177.002089:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+9:5594:x1875685442323712:12345-192.168.201.6@tcp:256: Request processed in 3385us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793177.002120:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 121 00000100:00100000:0.0:1788793177.005773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793177.006083:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323840 00000100:00100000:1.0:1788793177.006096:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323840 00000100:00100000:0.0:1788793177.006190:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:0.0:1788793177.006203:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+9:5594:x1875685442323840:12345-192.168.201.6@tcp:101: 00010000:00010000:0.0:1788793177.006228:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793177.006252:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d49 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793177.006291:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793177.006304:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793177.006324:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4400, rc 0) 00000100:00100000:0.0:1788793177.006400:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5594:x1875685442323840:12345-192.168.201.6@tcp:101: Request processed in 199us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793177.007228:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 122 00000100:00100000:1.0:1788793177.008741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793177.008910:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442323968 00000100:00100000:2.0:1788793177.008922:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442323968 00000100:00100000:2.0:1788793177.008978:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:2.0:1788793177.008988:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5594:x1875685442323968:12345-192.168.201.6@tcp:501: 00000100:00100000:2.0:1788793177.009372:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5594:x1875685442323968:12345-192.168.201.6@tcp:501: Request processed in 384us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793177.009381:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 123 00000100:00100000:1.0:1788793177.017228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793177.017699:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324096 00000100:00100000:2.0:1788793177.017714:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324096 00000100:00100000:2.0:1788793177.018256:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:2.0:1788793177.018270:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5594:x1875685442324096:12345-192.168.201.6@tcp:503: 00000100:00100000:2.0:1788793177.018709:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5594:x1875685442324096:12345-192.168.201.6@tcp:503: Request processed in 441us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793177.018719:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 124 00000100:00100000:0.0:1788793177.025503:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793177.025841:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324224 00000100:00100000:2.0:1788793177.025855:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324224 00000100:00100000:2.0:1788793177.025925:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:2.0:1788793177.025937:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:5618:x1875685442324224:12345-192.168.201.6@tcp:502: 00000100:00100000:2.0:1788793177.026655:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:5618:x1875685442324224:12345-192.168.201.6@tcp:502: Request processed in 715us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793177.026675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 125 00000100:00100000:3.0:1788793177.031418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793177.031782:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324352 00000100:00100000:0.0:1788793177.031801:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324352 00000100:00100000:0.0:1788793177.031885:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:0.0:1788793177.031897:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5618:x1875685442324352:12345-192.168.201.6@tcp:502: 00000100:00100000:0.0:1788793177.032407:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5618:x1875685442324352:12345-192.168.201.6@tcp:502: Request processed in 509us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793177.032417:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 126 00000100:00100000:3.0:1788793177.036633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793177.036745:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324480 00000100:00100000:0.0:1788793177.036759:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324480 00000100:00100000:0.0:1788793177.036825:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 4 00000100:00100000:0.0:1788793177.036836:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2364:x1875685442324480:12345-192.168.201.6@tcp:38: 00010000:00080000:0.0:1788793177.036877:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d4e85697-afe4-4757-83c7-d2349c69909f@192.168.201.6@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1788793177.036940:0:5837:0:(genops.c:1375:class_connect()) connect: client d4e85697-afe4-4757-83c7-d2349c69909f, cookie 0xa112893a8a83ce7c 00000004:00100000:0.0:1788793177.036981:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788793177.036989:0:5837:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788793177.065177:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9264bf301000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793177.065285:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:2364:x1875685442324480:12345-192.168.201.6@tcp:38: Request processed in 28447us (28664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793177.065298:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 4 00010000:00010000:2.0:1788793177.744396:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793178.082877:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.082935:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793178.083207:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324736 00000100:00100000:1.0:1788793178.083509:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324736 00000100:00100000:1.0:1788793178.083629:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324608 00000100:00100000:1.0:1788793178.083633:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324608 00000100:00100000:1.0:1788793178.083653:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788793178.083664:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+7:5594:x1875685442324736:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1788793178.083746:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1788793178.083987:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788793178.083999:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+7:5594:x1875685442324736:12345-192.168.201.6@tcp:41: Request processed in 326us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793178.084013:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 5 00000100:00100000:1.0:1788793178.084055:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788793178.084079:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:0:x1875685442324608:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1788793178.084107:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788793178.084192:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:0:x1875685442324608:12345-192.168.201.6@tcp:41: Request processed in 118us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793178.084199:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 6 00000100:00100000:1.0:1788793178.103348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793178.103560:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324864 00000100:00100000:0.0:1788793178.103572:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324864 00000100:00100000:0.0:1788793178.103676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:0.0:1788793178.103695:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:5594:x1875685442324864:12345-192.168.201.6@tcp:40: 00000100:00100000:0.0:1788793178.103824:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:5594:x1875685442324864:12345-192.168.201.6@tcp:40: Request processed in 130us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793178.103831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:3.0:1788793178.125176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.125281:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.125335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.125382:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.125433:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442324992 00000100:00100000:3.0:1788793178.125445:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442324992 00000100:00100000:3.0:1788793178.125486:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325120 00000100:00100000:3.0:1788793178.125488:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325120 00000100:00100000:3.0:1788793178.125506:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788793178.125515:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2364:x1875685442324992:12345-192.168.201.6@tcp:8: 00010000:00080000:3.0:1788793178.125560:0:6686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d4e85697-afe4-4757-83c7-d2349c69909f@192.168.201.6@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788793178.125605:0:6686:0:(genops.c:1375:class_connect()) connect: client d4e85697-afe4-4757-83c7-d2349c69909f, cookie 0xa112893a8a83ce83 00002000:00100000:3.0:1788793178.125621:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d4e85697-afe4-4757-83c7-d2349c69909f/ffff9264bf307000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788793178.125655:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788793178.126109:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788793178.126181:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9264bf301800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793178.126264:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:2364:x1875685442324992:12345-192.168.201.6@tcp:8: Request processed in 747us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793178.126273:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788793178.126301:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788793178.126307:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2364:x1875685442325120:12345-192.168.201.6@tcp:8: 00010000:00080000:3.0:1788793178.126326:0:6686:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d4e85697-afe4-4757-83c7-d2349c69909f@192.168.201.6@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:3.0:1788793178.126347:0:6686:0:(genops.c:1375:class_connect()) connect: client d4e85697-afe4-4757-83c7-d2349c69909f, cookie 0xa112893a8a83ce8a 00002000:00100000:3.0:1788793178.126353:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d4e85697-afe4-4757-83c7-d2349c69909f/ffff9264bf302000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788793178.126372:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788793178.126606:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788793178.126623:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9264bf307800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788793178.126648:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:2364:x1875685442325120:12345-192.168.201.6@tcp:8: Request processed in 339us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793178.126654:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788793178.127579:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325248 00000100:00100000:2.0:1788793178.127596:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325248 00000100:00100000:2.0:1788793178.127662:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:2.0:1788793178.127672:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:5594:x1875685442325248:12345-192.168.201.6@tcp:33: 00000100:00100000:2.0:1788793178.127805:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325376 00000100:00100000:2.0:1788793178.127810:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325376 00000100:00100000:2.0:1788793178.127852:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 127 00000100:00100000:2.0:1788793178.127860:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:2368:x1875685442325376:12345-192.168.201.6@tcp:400: 00000100:00100000:2.0:1788793178.127937:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:2368:x1875685442325376:12345-192.168.201.6@tcp:400: Request processed in 66us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793178.127945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 127 00000004:00080000:2.0:1788793178.145541:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 17773us 00000004:00200000:2.0:1788793178.154047:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788793178.154196:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:5594:x1875685442325248:12345-192.168.201.6@tcp:33: Request processed in 26519us (29031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793178.154207:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 0 00000100:00100000:1.0:1788793178.456734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793178.459256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325504 00000100:00100000:3.0:1788793178.459270:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325504 00000100:00100000:3.0:1788793178.459543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:3.0:1788793178.459555:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:5635:x1875685442325504:12345-192.168.201.6@tcp:101: 00010000:00010000:3.0:1788793178.459578:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793178.459648:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926481505800/0xa112893a8a83ce91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d73 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459734:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff926480031e00/0xa112893a8a83ce98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459767:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff926480031e00/0xa112893a8a83ce98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459781:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff926480031e00/0xa112893a8a83ce98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788793178.459817:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788793178.459821:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788793178.459839:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff926480031e00/0xa112893a8a83ce98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459864:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff926481505800/0xa112893a8a83ce91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d73 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459883:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff926480031e00/0xa112893a8a83ce98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d73 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793178.459891:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92649072b200) 00010000:00010000:3.0:1788793178.459895:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788793178.459898:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926480031e00, rc 0) 00000100:00100000:3.0:1788793178.459969:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+7:5635:x1875685442325504:12345-192.168.201.6@tcp:101: Request processed in 417us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793178.459977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00010000:00010000:3.0:1788793178.768382:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793178.896376:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461221120:0@lo:400: 00000100:00100000:0.0:1788793178.896381:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875685461220992:0@lo:400: 00000100:00100000:3.0:1788793178.896494:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461220864:0@lo:400: 00000100:00100000:1.0:1788793178.896526:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461220736:0@lo:400: 00000100:00100000:0.0:1788793178.896925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793178.897000:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220992 00000100:00100000:2.0:1788793178.897005:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793178.897007:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220992 00000100:00100000:2.0:1788793178.897063:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221120 00000100:00100000:2.0:1788793178.897067:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221120 00000100:00100000:0.0:1788793178.897069:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788793178.897077:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875685461220992:12345-0@lo:400: 00000100:00100000:2.0:1788793178.897096:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788793178.897101:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461221120:12345-0@lo:400: 00000100:00100000:0.0:1788793178.897126:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875685461220992:12345-0@lo:400: Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793178.897128:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba759500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461221120:12345-0@lo:400: Request processed in 27us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793178.897133:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788793178.897134:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788793178.897173:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788793178.897177:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788793178.897192:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113ea00 x1875685461221120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793178.897196:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875685461220992:0@lo:400: 00000100:00100000:2.0:1788793178.897202:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461221120:0@lo:400: 00000100:00100000:3.0:1788793178.898048:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793178.898081:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461221376:0@lo:400: 00000100:00100000:3.0:1788793178.898105:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793178.898275:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221376 00000100:00100000:2.0:1788793178.898281:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221376 00000100:00100000:2.0:1788793178.898323:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788793178.898331:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461221376:12345-0@lo:400: 00000100:00100000:2.0:1788793178.898370:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461221376:12345-0@lo:400: Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793178.898376:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788793178.898403:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113ed80 x1875685461221376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793178.898413:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788793178.898423:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461221376:0@lo:400: 00000100:00080000:3.0:1788793178.898504:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788793178.898589:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793178.898705:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461221248:0@lo:400: 00000100:00100000:1.0:1788793178.898730:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793178.898808:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221248 00000100:00100000:3.0:1788793178.898808:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220864 00000100:00100000:0.0:1788793178.898813:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221248 00000100:00100000:3.0:1788793178.898813:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220864 00000100:00100000:3.0:1788793178.898843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788793178.898850:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461220864:12345-0@lo:400: 00000100:00100000:0.0:1788793178.898888:0:5837:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788793178.898888:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461220864:12345-0@lo:400: Request processed in 38us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793178.898893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788793178.898895:0:5837:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788793178.898904:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788793178.898909:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461221248:12345-0@lo:400: 00000100:00100000:3.0:1788793178.898938:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264adf53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461221248:12345-0@lo:400: Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793178.898943:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788793178.898980:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461220864:0@lo:400: 00000100:00100000:0.0:1788793178.899044:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461221248:0@lo:400: 00000100:00100000:2.0:1788793178.899313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461220736 00000100:00100000:2.0:1788793178.899318:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461220736 00000100:00100000:2.0:1788793178.899391:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788793178.899399:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3309:x1875685461220736:12345-0@lo:400: 00000100:00100000:2.0:1788793178.899590:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3309:x1875685461220736:12345-0@lo:400: Request processed in 192us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793178.899597:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788793178.899656:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461220736:0@lo:400: 00000100:00080000:1.0:1788793178.903181:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788793179.410544:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461221504:0@lo:13: 00000100:00100000:0.0:1788793179.410613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793179.410764:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221504 00000100:00100000:1.0:1788793179.410774:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221504 00000100:00100000:1.0:1788793179.410837:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788793179.410847:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461221504:12345-0@lo:13: 00002000:00000024:1.0:1788793179.410868:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793179.410925:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461221504:12345-0@lo:13: Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793179.410932:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788793179.411071:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba75a300 x1875685461221504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793179.411089:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461221504:0@lo:13: 00010000:00010000:3.0:1788793179.793334:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793180.432689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461221632:0@lo:13: 00000100:00100000:2.0:1788793180.433496:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793180.433600:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221632 00000100:00100000:3.0:1788793180.433607:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221632 00000100:00100000:3.0:1788793180.433651:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788793180.433657:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461221632:12345-0@lo:13: 00002000:00000024:3.0:1788793180.433704:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793180.433749:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461221632:12345-0@lo:13: Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793180.433822:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788793180.434883:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788793180.435009:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d2680 x1875685461221632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793180.435032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461221632:0@lo:13: 00000100:00100000:0.0:1788793180.518265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793180.519531:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325632 00000100:00100000:1.0:1788793180.519545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325632 00000100:00100000:1.0:1788793180.519643:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:1.0:1788793180.519654:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+7:5688:x1875685442325632:12345-192.168.201.6@tcp:41: 00000004:00000024:1.0:1788793180.519705:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788793180.519791:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+7:5688:x1875685442325632:12345-192.168.201.6@tcp:41: Request processed in 138us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793180.519798:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00080000:0.0:1788793180.519891:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788793180.526627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793180.526731:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325760 00000100:00100000:3.0:1788793180.526742:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325760 00000100:00100000:3.0:1788793180.526828:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:3.0:1788793180.526838:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4e85697-afe4-4757-83c7-d2349c69909f+6:5688:x1875685442325760:12345-192.168.201.6@tcp:13: 00002000:00000024:3.0:1788793180.526886:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788793180.527134:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788793180.527379:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4e85697-afe4-4757-83c7-d2349c69909f+6:5688:x1875685442325760:12345-192.168.201.6@tcp:13: Request processed in 540us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793180.527387:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 9 00000100:00100000:2.0:1788793180.538645:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793180.539004:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442325888 00000100:00100000:3.0:1788793180.539014:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442325888 00000100:00100000:3.0:1788793180.539089:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788793180.539100:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4e85697-afe4-4757-83c7-d2349c69909f+6:5688:x1875685442325888:12345-192.168.201.6@tcp:13: 00002000:00000024:3.0:1788793180.539161:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793180.539242:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba758380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d4e85697-afe4-4757-83c7-d2349c69909f+6:5688:x1875685442325888:12345-192.168.201.6@tcp:13: Request processed in 144us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793180.539250:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00080000:0.0:1788793180.539578:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788793180.819611:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788793181.554806:0:6712:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d4e85697-afe4-4757-83c7-d2349c69909f 00010000:00010000:1.0:1788793181.849682:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788793182.558269:0:7644:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d4e85697-afe4-4757-83c7-d2349c69909f 00000001:00100000:3.0:1788793182.572261:0:5857:0:(tgt_lastrcvd.c:561:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d4e85697-afe4-4757-83c7-d2349c69909f 00010000:00010000:0.0:1788793182.871878:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793183.190321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793183.190372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793183.190400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793183.190424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793183.190451:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326016 00000100:00100000:1.0:1788793183.190461:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326016 00000100:00100000:1.0:1788793183.190509:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:1.0:1788793183.190522:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:2367:x1875685442326016:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793183.190593:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:2367:x1875685442326016:12345-192.168.201.6@tcp:400: Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793183.190601:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 129 00000100:00100000:1.0:1788793183.190646:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326272 00000100:00100000:1.0:1788793183.190651:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326272 00000100:00100000:1.0:1788793183.190686:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326400 00000100:00100000:1.0:1788793183.190689:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326400 00000100:00100000:1.0:1788793183.190706:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788793183.190711:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442326272:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793183.190739:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442326272:12345-192.168.201.6@tcp:400: Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793183.190746:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 7 00000100:00100000:1.0:1788793183.190768:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788793183.190775:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442326400:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793183.190802:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442326400:12345-192.168.201.6@tcp:400: Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793183.190808:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 8 00000100:00100000:1.0:1788793183.190826:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326144 00000100:00100000:1.0:1788793183.190830:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326144 00000100:00100000:1.0:1788793183.190858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00100000:1.0:1788793183.190864:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442326144:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793183.190892:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442326144:12345-192.168.201.6@tcp:400: Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793183.190898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 22 00000100:00080000:1.0:1788793183.191022:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788793183.191027:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788793183.191028:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788793183.566675:0:8301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788793183.892417:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793184.016931:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793184.016958:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461222144:0@lo:400: 00000100:00100000:2.0:1788793184.016972:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875685461222016:0@lo:400: 00000100:00100000:1.0:1788793184.017003:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461221888:0@lo:400: 00000100:00100000:0.0:1788793184.017075:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461222272:0@lo:400: 00000100:00100000:3.0:1788793184.020386:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793184.020456:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461221760:0@lo:400: 00000100:00100000:3.0:1788793184.020501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793184.020556:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222144 00000100:00100000:3.0:1788793184.020565:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222144 00000100:00100000:3.0:1788793184.020756:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788793184.020766:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461222144:12345-0@lo:400: 00000100:00100000:3.0:1788793184.020823:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461222144:12345-0@lo:400: Request processed in 58us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.020846:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788793184.020848:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788793184.020878:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788793184.020884:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221760 00000100:00100000:2.0:1788793184.020887:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221760 00010000:00080000:3.0:1788793184.020908:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba75a300 x1875685461222144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793184.020913:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788793184.020919:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3308:x1875685461221760:12345-0@lo:400: 00000100:00100000:3.0:1788793184.020922:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461222144:0@lo:400: 00000100:00100000:2.0:1788793184.020957:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3308:x1875685461221760:12345-0@lo:400: Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.020961:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222016 00000100:00100000:2.0:1788793184.020963:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788793184.020964:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222016 00000100:00100000:2.0:1788793184.021005:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461221760:0@lo:400: 00000100:00100000:3.0:1788793184.021006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788793184.021013:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875685461222016:12345-0@lo:400: 00000100:00080000:2.0:1788793184.021026:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788793184.021055:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875685461222016:12345-0@lo:400: Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.021061:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793184.022276:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875685461222016:0@lo:400: 00000100:00100000:0.0:1788793184.027515:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793184.027680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793184.027752:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461222400:0@lo:400: 00000100:00100000:1.0:1788793184.027814:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793184.027905:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222400 00000100:00100000:1.0:1788793184.027915:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222400 00000100:00100000:1.0:1788793184.027997:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788793184.028009:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461222400:12345-0@lo:400: 00000100:00100000:1.0:1788793184.028078:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461222400:12345-0@lo:400: Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793184.028086:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788793184.028166:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222272 00000100:00100000:3.0:1788793184.028178:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222272 00010000:00080000:1.0:1788793184.028202:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba759f80 x1875685461222400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793184.028235:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461222400:0@lo:400: 00000100:00100000:3.0:1788793184.028236:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461221888 00000100:00100000:3.0:1788793184.028247:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461221888 00000100:00100000:3.0:1788793184.028435:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788793184.028449:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461222272:12345-0@lo:400: 00000100:00100000:3.0:1788793184.029667:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461222272:12345-0@lo:400: Request processed in 1218us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.029678:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788793184.029702:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788793184.029710:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461221888:12345-0@lo:400: 00000100:00100000:3.0:1788793184.029750:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461221888:12345-0@lo:400: Request processed in 42us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.029756:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788793184.029817:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461222272:0@lo:400: 00000100:00100000:0.0:1788793184.029932:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461221888:0@lo:400: 00000100:00080000:2.0:1788793184.035411:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788793184.035423:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788793184.529176:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461222528:0@lo:13: 00000100:00100000:0.0:1788793184.529249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793184.529294:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222528 00000100:00100000:3.0:1788793184.529303:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222528 00000100:00100000:3.0:1788793184.529394:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788793184.529404:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461222528:12345-0@lo:13: 00002000:00000024:3.0:1788793184.529438:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793184.529499:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7144e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461222528:12345-0@lo:13: Request processed in 97us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793184.529506:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788793184.529587:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba75b800 x1875685461222528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793184.529615:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461222528:0@lo:13: 00010000:00010000:0.0:1788793184.913281:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793185.556317:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461222656:0@lo:13: 00000100:00100000:0.0:1788793185.556393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793185.556515:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461222656 00000100:00100000:1.0:1788793185.556525:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461222656 00000100:00100000:1.0:1788793185.556589:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788793185.556599:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461222656:12345-0@lo:13: 00002000:00000024:1.0:1788793185.556634:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793185.556679:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7146d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461222656:12345-0@lo:13: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793185.556686:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788793185.556768:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b6070000 x1875685461222656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793185.556785:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461222656:0@lo:13: 00010000:00010000:1.0:1788793185.936468:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788793186.422480:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1fea5820 20000000:00000080:0.0:1788793186.422505:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9264bf1adc00 uarg=0000000000000000 20000000:01000000:0.0:1788793186.422770:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788793186.422774:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788793186.422776:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788793186.422781:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788793186.422797:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788793186.422811:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788793186.422812:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788793186.423081:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788793186.423085:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793186.423939:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788793186.424580:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788793186.424623:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788793186.424655:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788793186.424665:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788793186.424666:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793186.425647:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788793186.426042:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788793186.426098:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788793186.426129:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788793186.426263:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788793186.426266:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793186.427648:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788793186.428135:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788793186.428293:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788793186.428328:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788793186.428342:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788793186.428344:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788793186.429122:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788793186.433790:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788793186.433836:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788793186.433932:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788793186.433948:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788793186.433967:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.433984:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.433991:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434009:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434017:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434024:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434030:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434036:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434045:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434052:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434059:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434097:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434112:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 9 pid: 5830 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.434164:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7147800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461222784:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788793186.434274:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434283:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 9 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.434289:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7146300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461222912:192.168.201.6@tcp:104: 00010000:00010000:0.0:1788793186.434311:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434317:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 18 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.434322:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7145500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223040:0@lo:104: 00000100:00100000:0.0:1788793186.434348:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793186.434770:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434780:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 18 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.434789:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7144a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223168:0@lo:104: 00000100:00100000:1.0:1788793186.434804:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223040 00000100:00100000:1.0:1788793186.434812:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223040 00000100:00100000:0.0:1788793186.434814:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793186.434856:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788793186.434857:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434865:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 18 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793186.434866:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223168 00000100:00100000:0.0:1788793186.434880:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7147b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223296:0@lo:104: 00000100:00100000:0.0:1788793186.434903:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793186.434920:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.434928:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 18 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.434936:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7147480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223424:0@lo:104: 00000100:00100000:0.0:1788793186.434955:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793186.434968:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223296 00000100:00100000:2.0:1788793186.434972:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223296 00010000:00010000:0.0:1788793186.434984:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.434988:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223424 00000100:00100000:2.0:1788793186.434990:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223424 00010000:00010000:0.0:1788793186.434992:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 18 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435000:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7144380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223552:0@lo:104: 00000100:00100000:2.0:1788793186.435002:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793186.435009:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8449:x1875685461223040:12345-0@lo:104: 00010000:00010000:2.0:1788793186.435022:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435030:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788793186.435044:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.435052:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 18 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435059:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223680:0@lo:104: 00010000:00010000:2.0:1788793186.435074:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793186.435077:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793186.435079:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7145180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8449:x1875685461223040:12345-0@lo:104: Request processed in 71us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.435086:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788793186.435090:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.435101:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223552 00000100:00100000:2.0:1788793186.435104:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223552 00010000:00010000:0.0:1788793186.435108:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 18 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.435114:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223680 00000100:00100000:2.0:1788793186.435116:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223680 00000100:00100000:2.0:1788793186.435125:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793186.435130:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:8449:x1875685461223296:12345-0@lo:104: 00010000:00010000:2.0:1788793186.435137:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435188:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788793186.435193:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+6:8449:x1875685461223296:12345-0@lo:104: Request processed in 62us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.435198:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793186.435219:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788793186.435225:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8449:x1875685461223424:12345-0@lo:104: 00010000:00010000:2.0:1788793186.435232:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435264:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788793186.435269:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7146a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8449:x1875685461223424:12345-0@lo:104: Request processed in 45us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.435274:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788793186.435285:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788793186.435290:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:8449:x1875685461223552:12345-0@lo:104: 00010000:00010000:2.0:1788793186.435297:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435327:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788793186.435331:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7144000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:8449:x1875685461223552:12345-0@lo:104: Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.435336:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788793186.435347:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788793186.435352:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223680:12345-0@lo:104: 00010000:00010000:2.0:1788793186.435359:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435383:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788793186.435387:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223680:12345-0@lo:104: Request processed in 36us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.435393:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788793186.435409:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788793186.435412:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788793186.435416:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435417:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435425:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481637400 already unused, calling callback (ffffffffc1da8c20) 00010000:00010000:3.0:1788793186.435425:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926482a11600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793186.435430:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793186.435430:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435440:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435440:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793186.435448:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793186.435448:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793186.435455:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788793186.435455:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793186.435486:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793186.435495:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223168 00010000:00010000:3.0:1788793186.435501:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788793186.435518:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788793186.435519:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793186.435524:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6076c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223168:12345-0@lo:104: 00010000:00010000:3.0:1788793186.435526:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926482a11600/0xa112893a8a83ce4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435540:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788793186.435543:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435549:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926482a10800 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793186.435552:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435568:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793186.435575:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793186.435579:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793186.435614:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.435649:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788793186.435654:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6076c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223168:12345-0@lo:104: Request processed in 131us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793186.435660:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788793186.435679:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223808:0@lo:104: 00010000:00010000:1.0:1788793186.435691:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788793186.435696:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435705:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793186.435709:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926482a10a00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:1.0:1788793186.435712:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.435719:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788793186.435725:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435727:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab39c0 going to sleep for 11 seconds 10000000:01000000:1.0:1788793186.435730:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788793186.435746:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7145500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223040:0@lo:104: 00000100:00100000:0.0:1788793186.435755:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7144a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223168:0@lo:104: 00000100:00100000:0.0:1788793186.435761:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7147b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223296:0@lo:104: 00010000:00010000:2.0:1788793186.435761:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.435767:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7147480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223424:0@lo:104: 00010000:00010000:2.0:1788793186.435767:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788793186.435773:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7144380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223552:0@lo:104: 00000100:00100000:0.0:1788793186.435779:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223680:0@lo:104: 00010000:00010000:2.0:1788793186.435782:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435787:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481637400/0xa112893a8a83ce05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435800:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788793186.435803:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435809:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481636c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793186.435812:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435824:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435826:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793186.435831:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435832:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1788793186.435837:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793186.435838:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435847:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435854:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788793186.435855:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83cdf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435858:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435865:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481636c00/0xa112893a8a83cdbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdc6 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435870:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788793186.435874:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435880:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481504400 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:3.0:1788793186.435883:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.435885:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793186.435887:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793186.435889:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793186.435890:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788793186.435896:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.435900:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224192:0@lo:103: 10000000:01000000:3.0:1788793186.435901:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788793186.435914:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435920:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788793186.435925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788793186.435925:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435931:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481504400/0xa112893a8a83ce21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83ce28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.435941:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793186.435943:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793186.435945:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793186.435952:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788793186.435952:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793186.435957:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224064:0@lo:103: 00000100:00100000:2.0:1788793186.435977:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793186.435984:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461223936:0@lo:103: 00000100:00100000:3.0:1788793186.436018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793186.436046:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461224448:0@lo:103: 00000100:00100000:3.0:1788793186.436066:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793186.436078:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788793186.436083:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461224320:0@lo:103: 00000100:00100000:2.0:1788793186.436095:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224192 00000100:00100000:2.0:1788793186.436099:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224192 00000100:00100000:3.0:1788793186.436102:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788793186.436117:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 19 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.436163:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224064 00000100:00100000:2.0:1788793186.436167:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224064 00010000:00010000:2.0:1788793186.436179:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 20 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.436190:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223936 00000100:00100000:2.0:1788793186.436192:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223936 00010000:00010000:2.0:1788793186.436201:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 21 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.436210:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224448 00000100:00100000:2.0:1788793186.436212:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224448 00010000:00010000:2.0:1788793186.436221:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 22 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.436231:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224320 00000100:00100000:2.0:1788793186.436233:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224320 00010000:00010000:2.0:1788793186.436243:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 23 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.436254:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793186.436260:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+23:3311:x1875685461224192:12345-0@lo:103: 00010000:00010000:2.0:1788793186.436269:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793186.436274:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 23 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436283:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 23 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436297:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481637c00/0xa112893a8a83cdfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cdf7 expref: 23 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436315:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788793186.436335:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788793186.436342:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+22:3311:x1875685461224192:12345-0@lo:103: Request processed in 83us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793186.436343:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788793186.436348:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788793186.436360:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793186.436381:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+21:3311:x1875685461224064:12345-0@lo:103: 00010000:00010000:2.0:1788793186.436388:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793186.436392:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 21 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436400:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 21 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436409:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505a00/0xa112893a8a83ce0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83ce05 expref: 21 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436417:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793186.436438:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+20:3311:x1875685461224064:12345-0@lo:103: Request processed in 72us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.436443:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788793186.436454:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788793186.436460:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3309:x1875685461223936:12345-0@lo:103: 00010000:00010000:2.0:1788793186.436467:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793186.436470:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 19 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436478:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 19 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436495:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481637200/0xa112893a8a83ce52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83ce4b expref: 19 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436504:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793186.436547:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:3309:x1875685461223936:12345-0@lo:103: Request processed in 87us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.436553:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788793186.436571:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788793186.436576:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:3309:x1875685461224448:12345-0@lo:103: 00010000:00010000:2.0:1788793186.436581:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793186.436583:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436589:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436595:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4a00/0xa112893a8a83ce28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83ce21 expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436601:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793186.436614:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:3309:x1875685461224448:12345-0@lo:103: Request processed in 39us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.436618:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788793186.436624:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788793186.436627:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:3309:x1875685461224320:12345-0@lo:103: 00010000:00010000:2.0:1788793186.436631:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793186.436634:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 15 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436654:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 15 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436660:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481504e00/0xa112893a8a83cdc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cdbf expref: 15 pid: 5829 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.436666:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793186.436680:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3309:x1875685461224320:12345-0@lo:103: Request processed in 53us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793186.436683:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788793186.436700:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224064:0@lo:103: 00000100:00100000:2.0:1788793186.436705:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224192:0@lo:103: 00000100:00100000:0.0:1788793186.437087:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461224320:0@lo:103: 00000100:00100000:0.0:1788793186.437093:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461223936:0@lo:103: 00000100:00100000:0.0:1788793186.437096:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3309:1875685461224448:0@lo:103: 00000100:00100000:0.0:1788793186.437204:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461223808 00000100:00100000:0.0:1788793186.437209:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461223808 00000100:00100000:0.0:1788793186.437231:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788793186.437237:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223808:12345-0@lo:104: 00010000:00010000:0.0:1788793186.437247:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.437308:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788793186.437314:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8449:x1875685461223808:12345-0@lo:104: Request processed in 77us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793186.437320:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788793186.437337:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788793186.437342:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.437354:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f5c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:0.0:1788793186.437358:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.437367:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788793186.437374:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793186.437379:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788793186.437429:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.437436:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788793186.437449:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.437455:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926482a10a00/0xa112893a8a83cde9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdf0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.437465:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793186.437466:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793186.437468:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793186.437477:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788793186.437484:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224576:0@lo:103: 00000100:00100000:1.0:1788793186.437505:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793186.437544:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224576 00000100:00100000:3.0:1788793186.437549:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224576 00010000:00010000:3.0:1788793186.437581:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793186.437601:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788793186.437607:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:3311:x1875685461224576:12345-0@lo:103: 00010000:00010000:3.0:1788793186.437616:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793186.437620:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.437628:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.437639:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cdf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cde9 expref: 14 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.437648:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793186.437651:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461223808:0@lo:104: 00000100:00100000:3.0:1788793186.437672:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3311:x1875685461224576:12345-0@lo:103: Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793186.437678:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788793186.437692:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224576:0@lo:103: 00010000:00010000:0.0:1788793186.438012:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.438019:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788793186.438053:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224704:0@lo:103: 00000100:00100000:2.0:1788793186.438080:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793186.438097:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224704 00000100:00100000:3.0:1788793186.438107:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224704 00010000:00010000:0.0:1788793186.438118:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.438126:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83cd95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cd9c expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793186.438182:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793186.438184:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788793186.438185:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793186.438357:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793186.438375:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793186.438384:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326528 00000100:00100000:3.0:1788793186.438387:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326528 00000100:00100000:1.0:1788793186.438400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00010000:00010000:3.0:1788793186.438400:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 10 pid: 5830 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793186.438410:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326656 00000100:00100000:1.0:1788793186.438413:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788793186.438413:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326656 00000100:00100000:1.0:1788793186.438420:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926491ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:3311:x1875685461224704:12345-0@lo:103: 00010000:00010000:3.0:1788793186.438423:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 11 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.438428:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793186.438433:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793186.438433:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788793186.438441:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793186.438441:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788793186.438446:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:175113f2-5ecd-47e7-965d-37390a6514ab+11:2365:x1875685442326528:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1788793186.438452:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5400/0xa112893a8a83cd9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cd95 expref: 13 pid: 5830 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.438452:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788793186.438456:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 11 pid: 5830 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.438461:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788793186.438465:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 11 pid: 5830 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793186.438473:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788793186.438629:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505000/0xa112893a8a83ce67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d18 expref: 11 pid: 5830 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793186.438640:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7147800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461222784:192.168.201.6@tcp:104: 00000100:00100000:2.0:1788793186.438651:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7146300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1875685461222912:192.168.201.6@tcp:104: 00010000:00010000:2.0:1788793186.438681:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793186.438941:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:175113f2-5ecd-47e7-965d-37390a6514ab+10:2365:x1875685442326528:12345-192.168.201.6@tcp:103: Request processed in 491us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793186.438948:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:1.0:1788793186.439000:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926491ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:3311:x1875685461224704:12345-0@lo:103: Request processed in 580us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793186.439006:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793186.439045:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:1.0:1788793186.439052:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:175113f2-5ecd-47e7-965d-37390a6514ab+10:2365:x1875685442326656:12345-192.168.201.6@tcp:103: 00010000:00010000:1.0:1788793186.439060:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788793186.439064:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 10 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439074:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 9 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439085:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5800/0xa112893a8a83ce60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d11 expref: 9 pid: 5829 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439104:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439111:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439124:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439131:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793186.439214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3311:1875685461224704:0@lo:103: 00010000:00010000:1.0:1788793186.439309:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439318:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439321:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f4600 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:1.0:1788793186.439634:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.439641:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.439838:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793186.439857:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.440902:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.440921:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4600/0xa112893a8a83ce9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793186.440945:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788793186.440995:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:175113f2-5ecd-47e7-965d-37390a6514ab+8:2365:x1875685442326656:12345-192.168.201.6@tcp:103: Request processed in 1940us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793186.441003:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00010000:00010000:3.0:1788793186.961416:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793187.984369:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788793187.984446:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788793187.984450:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926491114800 from 39 10000000:01000000:1.0:1788793187.984455:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788793187.984503:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793187.984516:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793187.984627:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793187.984714:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461224832:0@lo:101: 00000100:00100000:1.0:1788793187.984783:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793187.984889:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490993840 going to sleep for 11 seconds 00000100:00100000:3.0:1788793187.989439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224832 00000100:00100000:3.0:1788793187.989473:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224832 00000100:00100000:3.0:1788793187.992492:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788793187.992517:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+12:5832:x1875685461224832:12345-0@lo:101: 00010000:00010000:3.0:1788793187.992553:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793187.992575:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926480030c00/0xa112893a8a83cead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cea6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793187.992607:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926480030c00/0xa112893a8a83cead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cea6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793187.992619:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926480030c00/0xa112893a8a83cead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cea6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793187.992627:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926480030c00, rc 0) 00000100:00100000:3.0:1788793187.992724:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461224832:12345-0@lo:101: Request processed in 218us (7939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793187.992731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788793187.993308:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461224832:0@lo:101: 00010000:00010000:1.0:1788793187.993329:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cead expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793187.993339:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cead expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793187.993434:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461224960:0@lo:501: 00000100:00100000:1.0:1788793187.993491:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793187.993547:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490993840 going to sleep for 11 seconds 00000100:00100000:2.0:1788793187.993756:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461224960 00000100:00100000:2.0:1788793187.993765:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461224960 00000100:00100000:2.0:1788793187.993812:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788793187.993822:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461224960:12345-0@lo:501: 00000100:00100000:2.0:1788793187.994402:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461224960:12345-0@lo:501: Request processed in 580us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793187.994410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788793187.995263:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461224960:0@lo:501: 00000100:00100000:0.0:1788793187.995312:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225088:0@lo:503: 00000100:00100000:0.0:1788793187.995368:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793187.995407:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788793187.995468:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225088 00000100:00100000:1.0:1788793187.995476:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225088 00000100:00100000:1.0:1788793187.995522:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788793187.995546:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461225088:12345-0@lo:503: 00000100:00100000:1.0:1788793187.995733:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461225088:12345-0@lo:503: Request processed in 189us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793187.995741:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788793187.996175:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225088:0@lo:503: 00000100:00100000:3.0:1788793187.998059:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8466:1875685461225216:0@lo:502: 00000100:00100000:3.0:1788793187.998176:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793187.998215:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788793187.998744:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225216 00000100:00100000:1.0:1788793187.998752:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225216 00000100:00100000:1.0:1788793187.998802:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788793187.998812:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:8466:x1875685461225216:12345-0@lo:502: 00000100:00100000:1.0:1788793187.999377:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:8466:x1875685461225216:12345-0@lo:502: Request processed in 565us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793187.999386:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788793188.000863:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8466:1875685461225216:0@lo:502: 00000100:00100000:3.0:1788793188.001680:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8466:1875685461225344:0@lo:502: 00000100:00100000:3.0:1788793188.001753:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793188.001803:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490af4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.002054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225344 00000100:00100000:2.0:1788793188.002062:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225344 00000100:00100000:2.0:1788793188.002110:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788793188.002119:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:8466:x1875685461225344:12345-0@lo:502: 00000100:00100000:2.0:1788793188.002380:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:8466:x1875685461225344:12345-0@lo:502: Request processed in 261us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793188.002388:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788793188.002797:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8466:1875685461225344:0@lo:502: 00000040:00080000:3.0:1788793188.002828:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788793188.008277:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788793188.008320:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788793188.008333:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cead expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.008347:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a10400/0xa112893a8a83cea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cead expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793188.010135:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788793188.010164:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788793188.010169:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788793188.010216:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.010227:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.010257:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793188.010281:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225472:0@lo:101: 00000100:00100000:0.0:1788793188.010351:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.010402:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.010537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225472 00000100:00100000:1.0:1788793188.010546:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225472 00000100:00100000:1.0:1788793188.010596:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788793188.010606:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+13:5832:x1875685461225472:12345-0@lo:101: 00010000:00010000:1.0:1788793188.010619:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793188.010633:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a10200/0xa112893a8a83cebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ceb4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.010655:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a10200/0xa112893a8a83cebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ceb4 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.010666:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a10200/0xa112893a8a83cebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ceb4 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.010682:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a10200, rc 0) 00000100:00100000:1.0:1788793188.010730:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461225472:12345-0@lo:101: Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.010737:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788793188.010931:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225472:0@lo:101: 00010000:00010000:0.0:1788793188.010946:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cebb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.010954:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cebb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793188.011005:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225600:0@lo:501: 00000100:00100000:0.0:1788793188.011255:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.011322:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788793188.014742:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225600 00000100:00100000:3.0:1788793188.014773:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225600 00000100:00100000:3.0:1788793188.015216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788793188.015230:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461225600:12345-0@lo:501: 00000100:00100000:3.0:1788793188.015566:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461225600:12345-0@lo:501: Request processed in 339us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.016477:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225600:0@lo:501: 00000100:00100000:0.0:1788793188.016550:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225728:0@lo:503: 00000100:00100000:0.0:1788793188.016605:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.016655:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.016885:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225728 00000100:00100000:2.0:1788793188.016892:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225728 00000100:00100000:3.0:1788793188.025662:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788793188.027125:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788793188.027168:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461225728:12345-0@lo:503: 00000100:00100000:1.0:1788793188.027488:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461225728:12345-0@lo:503: Request processed in 349us (10880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.027496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788793188.030349:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461225728:0@lo:503: 00000100:00100000:0.0:1788793188.031247:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8467:1875685461225856:0@lo:502: 00000100:00100000:0.0:1788793188.031321:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.031361:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788793188.031438:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225856 00000100:00100000:3.0:1788793188.031445:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225856 00000100:00100000:3.0:1788793188.031496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788793188.031506:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8467:x1875685461225856:12345-0@lo:502: 00000100:00100000:3.0:1788793188.031751:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8467:x1875685461225856:12345-0@lo:502: Request processed in 246us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793188.031759:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788793188.031961:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8467:1875685461225856:0@lo:502: 00000020:01000000:0.0:1788793188.031996:0:8467:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793188.032005:0:8467:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793188.032008:0:8467:0:(obd_config.c:1547:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788793188.032013:0:8467:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788793188.032047:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8467:1875685461225984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.032081:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.032110:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788793188.032259:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461225984 00000100:00100000:3.0:1788793188.032265:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461225984 00000100:00100000:3.0:1788793188.032290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788793188.032296:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8467:x1875685461225984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793188.032427:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:8467:x1875685461225984:12345-0@lo:502:llog_process_th.0 Request processed in 130us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793188.032433:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788793188.032832:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8467:1875685461225984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793188.032864:0:8467:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788793188.032870:0:8467:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793188.032872:0:8467:0:(obd_config.c:1547:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788793188.032875:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788793188.033182:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788793188.033203:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788793188.033213:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cebb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.033225:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f5c00/0xa112893a8a83ceb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cebb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793188.033246:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788793188.033249:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9264b9db6800 from 39 10000000:01000000:2.0:1788793188.033252:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788793188.033278:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.033286:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.033296:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793188.033313:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.033349:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.033377:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788793188.033516:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226112 00000100:00100000:3.0:1788793188.033522:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226112 00000100:00100000:3.0:1788793188.033570:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788793188.033577:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+14:5832:x1875685461226112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788793188.033588:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788793188.033601:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926480031000/0xa112893a8a83cec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cec2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793188.033634:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926480031000/0xa112893a8a83cec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cec2 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793188.033659:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926480031000/0xa112893a8a83cec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cec2 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793188.033669:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926480031000, rc 0) 00000100:00100000:3.0:1788793188.033705:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793188.033710:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788793188.033976:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793188.033990:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cec9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.034000:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cec9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793188.034190:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.034217:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.034234:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788793188.034304:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226240 00000100:00100000:3.0:1788793188.034309:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226240 00000100:00100000:3.0:1788793188.034341:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788793188.034348:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788793188.034600:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793188.034607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788793188.034792:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.034822:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.034871:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.034903:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3240 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.035181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226368 00000100:00100000:2.0:1788793188.035187:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226368 00000100:00100000:2.0:1788793188.035219:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788793188.035228:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.035389:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793188.035396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788793188.038567:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.040395:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8468:1875685461226496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.040474:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.040515:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.040708:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226496 00000100:00100000:2.0:1788793188.040716:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226496 00000100:00100000:2.0:1788793188.040799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788793188.040809:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8468:x1875685461226496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793188.041278:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8468:x1875685461226496:12345-0@lo:502:llog_process_th.0 Request processed in 470us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793188.041294:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788793188.041414:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8468:1875685461226496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.041466:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8468:1875685461226624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.041504:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.048165:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3780 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.050625:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226624 00000100:00100000:1.0:1788793188.050654:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226624 00000100:00100000:1.0:1788793188.050720:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788793188.050729:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8468:x1875685461226624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793188.051399:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:8468:x1875685461226624:12345-0@lo:502:llog_process_th.0 Request processed in 667us (9891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.051408:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788793188.051520:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8468:1875685461226624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788793188.051570:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788793188.054501:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788793188.054582:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788793188.054596:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cec9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.054609:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481637200/0xa112893a8a83cec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cec9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793188.054620:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788793188.054623:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788793188.054924:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788793188.054964:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.054973:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.054984:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793188.055027:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.055090:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.055167:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264883c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.055288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226752 00000100:00100000:0.0:1788793188.055297:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226752 00000100:00100000:0.0:1788793188.055331:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788793188.055338:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+15:5832:x1875685461226752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793188.055350:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793188.055362:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f5e00/0xa112893a8a83ced7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ced0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.055384:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f5e00/0xa112893a8a83ced7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ced0 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.055395:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f5e00/0xa112893a8a83ced7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ced0 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.055403:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f5e00, rc 0) 00000100:00100000:0.0:1788793188.055438:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461226752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.055451:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788793188.055604:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793188.055622:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ced7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.055630:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83ced7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793188.055694:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.055719:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.055736:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264883c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.055794:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461226880 00000100:00100000:0.0:1788793188.055798:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461226880 00000100:00100000:0.0:1788793188.055817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788793188.055822:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461226880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.056104:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461226880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.056111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788793188.057771:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461226880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.057822:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.057893:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.057936:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264883c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.058002:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227008 00000100:00100000:0.0:1788793188.058009:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227008 00000100:00100000:0.0:1788793188.058053:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788793188.058062:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461227008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.058263:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461227008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.058271:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788793188.058553:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.058968:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8469:1875685461227136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793188.059008:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.059045:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264883c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.059136:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227136 00000100:00100000:0.0:1788793188.059175:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227136 00000100:00100000:0.0:1788793188.059201:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788793188.059207:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8469:x1875685461227136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.059363:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8469:x1875685461227136:12345-0@lo:502:llog_process_th.0 Request processed in 155us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.059370:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788793188.059448:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8469:1875685461227136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793188.059468:0:8469:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793188.059477:0:8469:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793188.059480:0:8469:0:(obd_config.c:1547:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788793188.059485:0:8469:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788793188.059504:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8469:1875685461227264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793188.059544:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.059567:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264883c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.059961:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227264 00000100:00100000:0.0:1788793188.059966:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227264 00000100:00100000:0.0:1788793188.059989:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788793188.059995:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8469:x1875685461227264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.060247:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:8469:x1875685461227264:12345-0@lo:502:llog_process_th.0 Request processed in 252us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.060255:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788793188.060333:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8469:1875685461227264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793188.060354:0:8469:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793188.060359:0:8469:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793188.060360:0:8469:0:(obd_config.c:1547:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788793188.060364:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788793188.060563:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788793188.060582:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788793188.060590:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ced7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.060602:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a10800/0xa112893a8a83ced0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83ced7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793188.060613:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788793188.060615:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff926488cd7800 from 39 10000000:01000000:0.0:1788793188.060618:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788793188.060813:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.060822:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.060831:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793188.060916:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.060948:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.060980:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.061094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227392 00000100:00100000:1.0:1788793188.061100:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227392 00000100:00100000:1.0:1788793188.061167:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788793188.061175:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461227392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793188.061186:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793188.061199:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a11600/0xa112893a8a83cee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cede expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.061219:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a11600/0xa112893a8a83cee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cede expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.061243:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a11600/0xa112893a8a83cee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cede expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.061251:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a11600, rc 0) 00000100:00100000:1.0:1788793188.061288:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461227392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.061294:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788793188.061427:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793188.061441:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cee5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.061457:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cee5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793188.061505:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.061542:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.061566:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.061632:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227520 00000100:00100000:1.0:1788793188.061636:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227520 00000100:00100000:1.0:1788793188.061674:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788793188.061680:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461227520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.062206:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461227520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 525us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.062214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788793188.062394:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.062430:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.062469:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.062548:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff926491ab3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.066798:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227648 00000100:00100000:2.0:1788793188.066817:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227648 00000100:00100000:0.0:1788793188.069348:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788793188.069363:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461227648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.069629:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461227648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (7158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.069637:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788793188.069763:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461227648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.072260:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8470:1875685461227776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793188.072347:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.077935:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227776 00000100:00100000:1.0:1788793188.077950:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227776 00000100:00100000:1.0:1788793188.078005:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788793188.078015:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8470:x1875685461227776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793188.078410:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8470:x1875685461227776:12345-0@lo:502:llog_process_th.0 Request processed in 396us (6062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.078419:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788793188.079213:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da240 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.079248:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8470:1875685461227776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.079321:0:8470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8470:1875685461227904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.079372:0:8470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793188.079397:0:8470:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.079505:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461227904 00000100:00100000:1.0:1788793188.079512:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461227904 00000100:00100000:1.0:1788793188.079564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788793188.079573:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8470:x1875685461227904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.080123:0:8470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8470:1875685461227904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788793188.080182:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788793188.080360:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788793188.080395:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788793188.080406:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cee5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.080417:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f4200/0xa112893a8a83cede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cee5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793188.080426:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788793188.080428:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788793188.080431:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788793188.080457:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.080466:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.080476:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793188.080492:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.080527:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.080583:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.080633:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8470:x1875685461227904:12345-0@lo:502:llog_process_th.0 Request processed in 445us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.080707:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788793188.080740:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228032 00000100:00100000:1.0:1788793188.080745:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228032 00000100:00100000:1.0:1788793188.080766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788793188.080774:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461228032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793188.080784:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793188.080795:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a11e00/0xa112893a8a83cef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83ceec expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.080816:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a11e00/0xa112893a8a83cef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83ceec expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.080826:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a11e00/0xa112893a8a83cef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83ceec expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.080835:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a11e00, rc 0) 00000100:00100000:1.0:1788793188.080965:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.080971:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788793188.081977:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793188.081999:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cef3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793188.082012:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cef3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793188.082090:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.082126:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.082182:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.082335:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228160 00000100:00100000:1.0:1788793188.082342:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228160 00000100:00100000:1.0:1788793188.082371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788793188.082379:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.083257:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.083279:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788793188.083605:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.083658:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.083706:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.083742:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.083791:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228288 00000100:00100000:0.0:1788793188.083803:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228288 00000100:00100000:0.0:1788793188.083850:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788793188.083858:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793188.084033:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.084040:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788793188.084270:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.084601:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8471:1875685461228416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793188.084647:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.084674:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.084748:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228416 00000100:00100000:0.0:1788793188.084754:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228416 00000100:00100000:0.0:1788793188.084772:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788793188.084778:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8471:x1875685461228416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793188.084947:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8471:x1875685461228416:12345-0@lo:502:llog_process_th.0 Request processed in 168us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.084954:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788793188.085161:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8471:1875685461228416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788793188.085183:0:8471:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788793188.085191:0:8471:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793188.085193:0:8471:0:(obd_config.c:1547:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788793188.085198:0:8471:0:(obd_config.c:1456:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788793188.085215:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8471:1875685461228544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788793188.085249:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793188.085264:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da480 going to sleep for 11 seconds 00000100:00100000:1.0:1788793188.085374:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228544 00000100:00100000:1.0:1788793188.085379:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228544 00000100:00100000:1.0:1788793188.085397:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788793188.085404:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8471:x1875685461228544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793188.085550:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8471:x1875685461228544:12345-0@lo:502:llog_process_th.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.085556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788793188.085631:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba759f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8471:1875685461228544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788793188.085661:0:8471:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788793188.085665:0:8471:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788793188.085667:0:8471:0:(obd_config.c:1547:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788793188.085671:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788793188.085933:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788793188.085949:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788793188.085958:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cef3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.085970:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481637c00/0xa112893a8a83ceec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cef3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788793188.085980:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788793188.085983:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff926488538000 from 1 10000000:01000000:1.0:1788793188.085986:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788793188.086010:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.086017:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.086094:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793188.086109:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.086176:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.086198:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ae0a6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793188.086253:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228672 00000100:00100000:0.0:1788793188.086257:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228672 00000100:00100000:0.0:1788793188.086277:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788793188.086283:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461228672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793188.086292:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793188.086304:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4800/0xa112893a8a83cf01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cefa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.086325:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4800/0xa112893a8a83cf01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cefa expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.086335:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4800/0xa112893a8a83cf01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cefa expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.086344:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4800, rc 0) 00000100:00100000:0.0:1788793188.086391:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461228672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.086397:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788793188.086461:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788793188.086474:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793188.086483:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cf01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793188.086524:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793188.086557:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793188.086581:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264ae0a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788793188.086635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228800 00000100:00100000:2.0:1788793188.086744:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228800 00000100:00100000:2.0:1788793188.086766:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788793188.086772:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461228800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793188.087517:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461228800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 742us (956us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788793188.087526:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788793188.091327:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461228800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788793188.091375:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788793188.091387:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793188.091399:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926482a11a00/0xa112893a8a83cefa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793188.310085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793188.310129:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793188.310194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793188.310235:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793188.310318:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326912 00000100:00100000:1.0:1788793188.310328:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326912 00000100:00100000:1.0:1788793188.310399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788793188.310409:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442326912:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793188.310496:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442326912:12345-192.168.201.6@tcp:400: Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.310504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 26 00000100:00100000:1.0:1788793188.310554:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327040 00000100:00100000:1.0:1788793188.310558:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327040 00000100:00100000:1.0:1788793188.310584:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327168 00000100:00100000:1.0:1788793188.310586:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327168 00000100:00100000:1.0:1788793188.310601:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788793188.310606:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442327040:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793188.310631:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442327040:12345-192.168.201.6@tcp:400: Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.310653:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:1.0:1788793188.310666:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:1.0:1788793188.310672:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442327168:12345-192.168.201.6@tcp:400: 00000100:00100000:1.0:1788793188.310697:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba759180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442327168:12345-192.168.201.6@tcp:400: Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793188.310703:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 12 00000100:00100000:0.0:1788793188.310971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442326784 00000100:00100000:0.0:1788793188.310976:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442326784 00000100:00100000:0.0:1788793188.311014:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00100000:0.0:1788793188.311022:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+8:2367:x1875685442326784:12345-192.168.201.6@tcp:400: 00000100:00100000:0.0:1788793188.311057:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+8:2367:x1875685442326784:12345-192.168.201.6@tcp:400: Request processed in 37us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793188.311064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 163 00000100:00080000:2.0:1788793188.311334:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788793188.311338:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788793188.311341:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788793189.012680:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793189.136573:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461228928:0@lo:400:kworker.0 00000100:00100000:0.0:1788793189.136656:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793189.136770:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461228928 00000100:00100000:2.0:1788793189.136779:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461228928 00000100:00100000:2.0:1788793189.136837:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788793189.136847:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3308:x1875685461228928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.137032:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461229056:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.137068:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793189.137118:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229056 00000100:00100000:1.0:1788793189.137122:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229056 00000100:00100000:1.0:1788793189.137191:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793189.137198:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461229056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.137240:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875685461229056:12345-0@lo:400:kworker.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793189.137247:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788793189.137300:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875685461229056:0@lo:400:kworker.0 00000100:00100000:2.0:1788793189.140712:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3308:x1875685461228928:12345-0@lo:400:kworker.0 Request processed in 3857us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793189.140751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788793189.141987:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461229312:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142111:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461229184:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142179:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793189.142238:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461229568:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793189.142300:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788793189.142305:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461229440:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142324:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793189.142370:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229184 00000100:00100000:1.0:1788793189.142380:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229184 00000100:00100000:1.0:1788793189.142437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229440 00000100:00100000:1.0:1788793189.142441:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229440 00000100:00100000:1.0:1788793189.142463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788793189.142473:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461229184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142544:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875685461229184:12345-0@lo:400:kworker.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793189.142552:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788793189.142570:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793189.142576:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461229440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142610:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875685461229440:12345-0@lo:400:kworker.0 Request processed in 34us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793189.142616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788793189.142656:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875685461229184:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142685:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229568 00000100:00100000:1.0:1788793189.142688:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229568 00000100:00100000:1.0:1788793189.142717:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788793189.142723:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461229568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.142755:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461229568:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793189.142761:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788793189.142792:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875685461229440:0@lo:400:kworker.0 00010000:00080000:1.0:1788793189.142804:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d2d80 x1875685461229568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793189.142813:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461229568:0@lo:400:kworker.0 00000100:00080000:2.0:1788793189.142993:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788793189.142999:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788793189.143151:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793189.143273:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229312 00000100:00100000:1.0:1788793189.143278:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229312 00000100:00100000:1.0:1788793189.143329:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788793189.143335:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461229312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.143373:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461229312:12345-0@lo:400:kworker.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793189.143378:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788793189.143478:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788793189.143540:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b71d3800 x1875685461229312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793189.143551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461229312:0@lo:400:kworker.0 00000100:00100000:0.0:1788793189.143959:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b71d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461228928:0@lo:400:kworker.0 00000100:00100000:1.0:1788793189.648510:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461229696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788793189.648585:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793189.656382:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229696 00000100:00100000:0.0:1788793189.656399:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229696 00000100:00100000:0.0:1788793189.656466:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788793189.656476:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461229696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788793189.656522:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788793189.656617:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461229696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (8031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793189.656625:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788793189.656993:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264ba75b800 x1875685461229696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793189.657012:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461229696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788793190.034743:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788793190.673606:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788793190.673630:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461229824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788793190.673698:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793190.674264:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461229824 00000100:00100000:1.0:1788793190.674274:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461229824 00000100:00100000:1.0:1788793190.674347:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788793190.674359:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461229824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788793190.674405:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793190.674467:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461229824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793190.674475:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788793190.674520:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b6071500 x1875685461229824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793190.674539:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461229824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788793191.056581:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793192.080378:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793192.410492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793192.410590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327296 00000100:00100000:1.0:1788793192.410783:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327296 00000100:00100000:1.0:1788793192.410869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:1.0:1788793192.410880:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+8:5609:x1875685442327296:12345-192.168.201.6@tcp:101: 00010000:00010000:1.0:1788793192.410895:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788793192.410915:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926482a10000/0xa112893a8a83cf08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d7a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793192.410942:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926482a10000/0xa112893a8a83cf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d7a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793192.410953:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926482a10000/0xa112893a8a83cf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d7a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793192.410962:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926482a10000, rc 0) 00000100:00100000:1.0:1788793192.411355:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327296:12345-192.168.201.6@tcp:101: Request processed in 475us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793192.411363:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 165 00000100:00100000:0.0:1788793192.422819:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793192.423006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327424 00000100:00100000:2.0:1788793192.423017:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327424 00000100:00100000:2.0:1788793192.423084:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1788793192.423093:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327424:12345-192.168.201.6@tcp:501: 00000100:00100000:2.0:1788793192.424369:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327424:12345-192.168.201.6@tcp:501: Request processed in 1271us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793192.424380:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 166 00000100:00100000:2.0:1788793192.437346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793192.437440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327552 00000100:00100000:1.0:1788793192.437451:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327552 00000100:00100000:1.0:1788793192.437520:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:1.0:1788793192.437530:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327552:12345-192.168.201.6@tcp:503: 00000100:00100000:1.0:1788793192.437760:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327552:12345-192.168.201.6@tcp:503: Request processed in 231us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793192.437767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 167 00000100:00100000:3.0:1788793192.461872:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793192.461952:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327680 00000100:00100000:2.0:1788793192.461964:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327680 00000100:00100000:2.0:1788793192.462593:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1788793192.462617:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:6106:x1875685442327680:12345-192.168.201.6@tcp:502: 00000100:00100000:2.0:1788793192.463404:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:6106:x1875685442327680:12345-192.168.201.6@tcp:502: Request processed in 787us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793192.463414:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 168 00000100:00100000:2.0:1788793192.470331:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:0.0:1788793192.470423:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327808 00000100:00100000:0.0:1788793192.470433:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327808 00000100:00100000:0.0:1788793192.470493:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:0.0:1788793192.470502:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+9:6106:x1875685442327808:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788793192.471341:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+9:6106:x1875685442327808:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 837us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793192.471351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 169 00000100:00100000:3.0:1788793192.475242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793192.475355:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442327936 00000100:00100000:2.0:1788793192.475365:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442327936 00000100:00100000:2.0:1788793192.475409:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:2.0:1788793192.475419:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442327936:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793192.475435:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793192.475486:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481637600/0xa112893a8a83cf0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d81 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793192.475513:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481637600/0xa112893a8a83cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d81 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793192.475525:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481637600/0xa112893a8a83cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d81 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793192.475534:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481637600, rc 0) 00000100:00100000:2.0:1788793192.475596:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442327936:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 178us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793192.475604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 170 00000100:00100000:3.0:1788793192.479013:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793192.479183:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328064 00000100:00100000:1.0:1788793192.479193:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328064 00000100:00100000:1.0:1788793192.479244:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 171 00000100:00100000:1.0:1788793192.479253:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442328064:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793192.479548:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442328064:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 295us (542us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788793192.479556:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 171 00010000:00010000:1.0:1788793193.104743:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793193.432474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793193.432517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793193.432548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793193.432570:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793193.435127:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328192 00000100:00100000:1.0:1788793193.435157:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328192 00000100:00100000:1.0:1788793193.435221:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:1.0:1788793193.435232:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:2367:x1875685442328192:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788793193.435314:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:2367:x1875685442328192:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 84us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793193.435322:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 172 00000100:00100000:1.0:1788793193.435358:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328320 00000100:00100000:1.0:1788793193.435373:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328320 00000100:00100000:1.0:1788793193.435412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788793193.435419:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442328320:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788793193.435469:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:2367:x1875685442328320:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 49us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793193.435475:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 30 00000100:00100000:1.0:1788793193.435496:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328448 00000100:00100000:1.0:1788793193.435500:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328448 00000100:00100000:1.0:1788793193.435527:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328576 00000100:00100000:1.0:1788793193.435531:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328576 00000100:00100000:1.0:1788793193.435545:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788793193.435551:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442328448:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788793193.435578:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442328448:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 27us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793193.435601:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 15 00000100:00100000:1.0:1788793193.435613:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00100000:1.0:1788793193.435619:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442328576:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788793193.435644:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d4e85697-afe4-4757-83c7-d2349c69909f+5:2367:x1875685442328576:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 26us (3074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793193.435650:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 16 00000100:00080000:1.0:1788793193.436041:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788793193.436045:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788793193.436048:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788793194.008823:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2599bc90 20000000:00000080:0.0:1788793194.008840:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9264bf681c00 uarg=0000000000000000 20000000:01000000:0.0:1788793194.008878:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788793194.008883:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788793194.008888:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788793194.011371:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788793194.011499:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788793194.022339:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788793194.022417:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788793194.022492:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788793194.022513:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788793194.022534:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022551:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022559:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022566:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022575:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022598:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022637:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022653:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 9 pid: 5829 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.022667:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461229952:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788793194.022816:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022826:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 18 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.022836:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230080:0@lo:104: 00000100:00100000:1.0:1788793194.022874:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793194.022913:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022921:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 18 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.022928:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230208:0@lo:104: 00000100:00100000:1.0:1788793194.022951:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788793194.022973:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.022992:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 18 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.023000:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230336:0@lo:104: 00000100:00100000:1.0:1788793194.023019:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff926485585cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788793194.024508:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788793194.024543:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.024563:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230080 00000100:00100000:2.0:1788793194.024572:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230080 00000100:00100000:2.0:1788793194.024609:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230208 00000100:00100000:2.0:1788793194.024612:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230208 00000100:00100000:2.0:1788793194.024622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230336 00000100:00100000:2.0:1788793194.024624:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230336 00000100:00100000:2.0:1788793194.024637:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788793194.024646:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8509:x1875685461230080:12345-0@lo:104: 00010000:00010000:2.0:1788793194.024662:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.024745:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788793194.024751:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+5:8509:x1875685461230080:12345-0@lo:104: Request processed in 107us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.024758:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788793194.024786:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788793194.024793:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b66c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:8509:x1875685461230208:12345-0@lo:104: 00010000:00010000:2.0:1788793194.024803:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.024839:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788793194.024844:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b66c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+4:8509:x1875685461230208:12345-0@lo:104: Request processed in 53us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.024850:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788793194.024882:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793194.024888:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264ba75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8509:x1875685461230336:12345-0@lo:104: 00010000:00010000:2.0:1788793194.024894:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.024925:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788793194.024931:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264ba75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+3:8509:x1875685461230336:12345-0@lo:104: Request processed in 43us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.024937:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788793194.024953:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788793194.024959:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.024966:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481504c00 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793194.024970:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.024978:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793194.024995:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793194.025000:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788793194.025044:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025051:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793194.025073:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025079:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481504c00/0xa112893a8a83cdb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cdb8 expref: -99 pid: 7625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025094:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788793194.025097:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025103:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926481505600 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793194.025106:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025112:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793194.025118:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793194.025123:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788793194.025180:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025187:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793194.025194:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025200:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff926481505600/0xa112893a8a83cce6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cced expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025208:0:7632:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788793194.025211:0:7632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025216:0:7632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264880f4000 already unused, calling callback (ffffffffc1da8c20) 10000000:00010000:2.0:1788793194.025219:0:7632:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025226:0:7632:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788793194.025232:0:7632:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788793194.025238:0:7632:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788793194.025250:0:7632:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025255:0:7632:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788793194.025272:0:7632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025288:0:7632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.106@tcp lock: ffff9264880f4000/0xa112893a8a83cc84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa112893a8a83cc8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025300:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793194.025302:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793194.025304:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793194.025310:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793194.025315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793194.025334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461230464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793194.025368:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.025404:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788793194.025410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461230592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793194.025458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.025497:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461230720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793194.025519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.025550:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230464 00000100:00100000:2.0:1788793194.025554:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230464 00010000:00010000:2.0:1788793194.025574:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 19 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793194.025594:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230592 00000100:00100000:2.0:1788793194.025597:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230592 00010000:00010000:2.0:1788793194.025607:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 20 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793194.025617:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230720 00000100:00100000:2.0:1788793194.025620:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230720 00010000:00010000:2.0:1788793194.025628:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 21 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793194.025649:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793194.025655:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b966fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+21:3308:x1875685461230464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788793194.025665:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793194.025670:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 21 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025678:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 21 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025692:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793194.025721:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b966fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+21:3308:x1875685461230464:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.025727:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793194.025740:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788793194.025745:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+20:3308:x1875685461230592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788793194.025752:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793194.025756:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 20 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025763:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 20 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025772:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793194.025791:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+20:3308:x1875685461230592:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.025796:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788793194.025808:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793194.025819:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3310:x1875685461230720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788793194.025826:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793194.025831:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 19 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025838:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 19 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.025847:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793194.025870:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3310:x1875685461230720:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.025875:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788793194.025912:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461230720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793194.025932:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba758700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461230592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788793194.025939:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264ba75a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3308:1875685461230464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788793194.028985:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5200/0xa112893a8a83cdb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cdb1 expref: 18 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.029025:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230080:0@lo:104: 00010000:00010000:1.0:1788793194.029040:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f5600/0xa112893a8a83cced lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cce6 expref: 17 pid: 5828 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.029049:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230208:0@lo:104: 00010000:00010000:1.0:1788793194.029060:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff926481505e00/0xa112893a8a83cc8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa112893a8a83cc84 expref: 16 pid: 5830 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.029070:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461230336:0@lo:104: 00000100:00100000:1.0:1788793194.038468:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875685461229952:192.168.201.6@tcp:104: 00010000:00010000:1.0:1788793194.038510:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788793194.038889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793194.038970:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328704 00000100:00100000:2.0:1788793194.038978:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328704 00010000:00010000:2.0:1788793194.039029:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793194.039069:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 24 00000100:00100000:2.0:1788793194.039079:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:175113f2-5ecd-47e7-965d-37390a6514ab+10:2365:x1875685442328704:12345-192.168.201.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788793194.039093:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788793194.039099:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039110:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039181:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264880f4400/0xa112893a8a83ce75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d49 expref: 10 pid: 5829 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039197:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039205:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039220:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039226:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039233:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039239:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039245:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9264ba155c00 already unused, calling callback (ffffffffc17728b0) 00010000:00010000:2.0:1788793194.039249:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039257:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039268:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.039288:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788793194.039344:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:175113f2-5ecd-47e7-965d-37390a6514ab+9:2365:x1875685442328704:12345-192.168.201.6@tcp:103:ldlm_bl.0 Request processed in 266us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.039352:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 24 00010000:00010000:0.0:1788793194.039422:0:8509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793194.039452:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793194.039460:0:8509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9264ba155c00/0xa112893a8a83cf16 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788793194.129371:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793194.257316:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788793194.257485:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461230976:0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.257550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.257603:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788793194.257608:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461231104:0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.257632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.257666:0:8211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230976 00000100:00100000:2.0:1788793194.257673:0:8211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230976 00000100:00100000:2.0:1788793194.257722:0:8211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793194.257730:0:8211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461230976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.257775:0:8211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461230976:12345-0@lo:400:kworker.0 Request processed in 46us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.257782:0:8211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788793194.257802:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231104 00000100:00100000:2.0:1788793194.257805:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231104 00000100:00100000:2.0:1788793194.257830:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788793194.257835:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461231104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.257860:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461231104:12345-0@lo:400:kworker.0 Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.257866:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788793194.257879:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788793194.257883:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788793194.257909:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92649113f800 x1875685461231104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793194.257937:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461231104:0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.257948:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461230976:0@lo:400:kworker.0 00000100:00100000:3.0:1788793194.259043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461231232:0@lo:400:kworker.0 00000100:00100000:3.0:1788793194.259244:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793194.259281:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461230848:0@lo:400:kworker.0 00000100:00100000:3.0:1788793194.259305:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793194.259633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231232 00000100:00100000:2.0:1788793194.259641:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231232 00000100:00100000:2.0:1788793194.259725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461230848 00000100:00100000:2.0:1788793194.259729:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461230848 00000100:00100000:2.0:1788793194.259751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788793194.259759:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461231232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.259810:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461231232:12345-0@lo:400:kworker.0 Request processed in 52us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.259816:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788793194.259829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788793194.259836:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b71d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461230848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.259863:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b71d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461230848:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.259869:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788793194.259911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461231232:0@lo:400:kworker.0 00000100:00100000:2.0:1788793194.259921:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461230848:0@lo:400:kworker.0 00000100:00100000:0.0:1788793194.260076:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461231360:0@lo:400:kworker.0 00000100:00100000:0.0:1788793194.260118:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793194.260286:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231360 00000100:00100000:1.0:1788793194.260292:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231360 00000100:00080000:3.0:1788793194.260381:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788793194.260386:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788793194.260560:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788793194.260568:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92649113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461231360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788793194.260635:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92649113f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875685461231360:12345-0@lo:400:kworker.0 Request processed in 68us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793194.260642:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788793194.260691:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b6071f80 x1875685461231360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788793194.260702:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875685461231360:0@lo:400:kworker.0 00000100:00100000:3.0:1788793194.481933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793194.482325:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328832 00000100:00100000:2.0:1788793194.482336:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328832 00000100:00100000:2.0:1788793194.482396:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:2.0:1788793194.482407:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+9:5609:x1875685442328832:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793194.482434:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788793194.482472:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff926481636600/0xa112893a8a83cf1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfcf1ff1e28778d88 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.482502:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff926481636600/0xa112893a8a83cf1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d88 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.482514:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff926481636600/0xa112893a8a83cf1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.6@tcp remote: 0xfcf1ff1e28778d88 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793194.482524:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff926481636600, rc 0) 00000100:00100000:2.0:1788793194.482586:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442328832:12345-192.168.201.6@tcp:101:ll_cfg_requeue.0 Request processed in 180us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.482594:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 173 00000100:00100000:3.0:1788793194.490379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793194.490498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442328960 00000100:00100000:1.0:1788793194.490508:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442328960 00000100:00100000:1.0:1788793194.490566:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:1.0:1788793194.490577:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442328960:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788793194.490857:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442328960:12345-192.168.201.6@tcp:501:ll_cfg_requeue.0 Request processed in 281us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793194.490866:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 174 00000100:00100000:3.0:1788793194.497519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793194.497783:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329088 00000100:00100000:1.0:1788793194.497795:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329088 00000100:00100000:1.0:1788793194.497860:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:1.0:1788793194.497870:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442329088:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793194.498175:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:175113f2-5ecd-47e7-965d-37390a6514ab+10:5609:x1875685442329088:12345-192.168.201.6@tcp:503:ll_cfg_requeue.0 Request processed in 268us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793194.498184:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 175 00000100:00100000:3.0:1788793194.510126:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793194.510242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329216 00000100:00100000:2.0:1788793194.510253:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329216 00000100:00100000:2.0:1788793194.510317:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1788793194.510328:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:6164:x1875685442329216:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788793194.510721:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:6164:x1875685442329216:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 393us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793194.510730:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 176 00000100:00100000:2.0:1788793194.517208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793194.517399:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329344 00000100:00100000:3.0:1788793194.517409:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329344 00000100:00100000:3.0:1788793194.517475:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:3.0:1788793194.517486:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:6164:x1875685442329344:12345-192.168.201.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788793194.517808:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff92648848a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:6164:x1875685442329344:12345-192.168.201.6@tcp:502:llog_process_th.0 Request processed in 323us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793194.517817:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 177 00000100:00100000:3.0:1788793194.769324:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461231488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788793194.769566:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793194.770367:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231488 00000100:00100000:1.0:1788793194.770377:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231488 00000100:00100000:3.0:1788793194.776368:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788793194.776382:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461231488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788793194.776431:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793194.776535:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461231488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (7123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793194.776543:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788793194.776616:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b6073100 x1875685461231488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793194.776640:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461231488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788793195.156972:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788793195.802536:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461231616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788793195.802630:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793195.802733:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231616 00000100:00100000:1.0:1788793195.802743:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231616 00000100:00100000:1.0:1788793195.802814:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788793195.802824:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461231616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788793195.802876:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793195.802935:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875685461231616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793195.802943:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788793195.803006:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b6071180 x1875685461231616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793195.803028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875685461231616:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788793195.922904:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788793195.922917:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926491114800 from 4 10000000:01000000:2.0:1788793195.922925:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788793195.923962:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793195.923982:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793195.924666:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793195.924832:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461231744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.924930:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793195.925300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231744 00000100:00100000:0.0:1788793195.925311:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231744 00000100:00100000:0.0:1788793195.925379:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788793195.925400:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+16:5832:x1875685461231744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793195.925421:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793195.925441:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cf2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cf24 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.925472:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cf2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cf24 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.925487:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4c00/0xa112893a8a83cf2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cf24 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.925498:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4c00, rc 0) 00000100:00100000:0.0:1788793195.925623:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461231744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.925632:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788793195.926088:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793195.926119:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461231744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793195.926137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf2b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793195.926161:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cf2b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793195.926253:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461231872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.926290:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793195.926315:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793195.926359:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461231872 00000100:00100000:2.0:1788793195.926364:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461231872 00000100:00100000:2.0:1788793195.926405:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788793195.926412:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461231872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.926747:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461231872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793195.926767:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788793195.926802:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461231872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.926834:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.926877:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793195.926899:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da780 going to sleep for 11 seconds 00000100:00100000:2.0:1788793195.926910:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232000 00000100:00100000:2.0:1788793195.926914:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232000 00000100:00100000:2.0:1788793195.926934:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788793195.926939:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461232000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.927091:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461232000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793195.927097:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788793195.927128:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793195.939986:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8570:1875685461232128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793195.940994:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793195.941495:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff926488d8ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.942487:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232128 00000100:00100000:0.0:1788793195.942503:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232128 00000100:00100000:0.0:1788793195.942581:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788793195.942592:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8570:x1875685461232128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793195.944296:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8570:x1875685461232128:12345-0@lo:502:llog_process_th.0 Request processed in 1698us (3297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.944310:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788793195.946837:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8570:1875685461232128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793195.946905:0:8570:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788793195.946919:0:8570:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793195.946921:0:8570:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788793195.946931:0:8570:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff926491114800 00000020:00000080:1.0:1788793195.946933:0:8570:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788793195.947050:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8570:1875685461232256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788793195.947160:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793195.947210:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff926490ae0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.957674:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232256 00000100:00100000:0.0:1788793195.957697:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232256 00000100:00100000:0.0:1788793195.957793:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788793195.957805:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8570:x1875685461232256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793195.959504:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff926488488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:8570:x1875685461232256:12345-0@lo:502:llog_process_th.0 Request processed in 1694us (12337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.959517:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788793195.960259:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b6071180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8570:1875685461232256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788793195.960308:0:8570:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788793195.960318:0:8570:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788793195.960320:0:8570:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788793195.960325:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788793195.960971:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788793195.961001:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788793195.961016:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf2b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793195.961031:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926481636200/0xa112893a8a83cf24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf2b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788793195.961171:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788793195.961175:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9264b9db6800 from 4 10000000:01000000:3.0:1788793195.961179:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788793195.961225:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793195.961235:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793195.961246:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788793195.961274:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788793195.961340:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793195.961386:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.964732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232384 00000100:00100000:0.0:1788793195.964752:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232384 00000100:00100000:0.0:1788793195.964814:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788793195.964828:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+17:5832:x1875685461232384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793195.964850:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793195.966195:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cf39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cf32 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.966239:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cf39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cf32 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.966253:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4a00/0xa112893a8a83cf39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cf32 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793195.966263:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4a00, rc 0) 00000100:00100000:0.0:1788793195.966382:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461232384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1558us (5042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.966412:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788793195.966457:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7141180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788793195.966483:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf39 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788793195.966493:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cf39 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788793195.966605:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788793195.966643:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793195.966672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232512 00000100:00100000:0.0:1788793195.966678:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232512 00000100:00100000:2.0:1788793195.966694:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264914da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.966707:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788793195.966714:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461232512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793195.968503:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461232512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1781us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.968517:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788793195.968575:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793195.968632:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793195.968683:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793195.968712:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.972289:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232640 00000100:00100000:0.0:1788793195.972311:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232640 00000100:00100000:0.0:1788793195.972369:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788793195.972381:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461232640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793195.972707:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461232640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.972716:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788793195.975214:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461232640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793195.989707:0:8575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8575:1875685461232768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793195.989819:0:8575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793195.989870:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232768 00000100:00100000:0.0:1788793195.989879:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232768 00000100:00100000:0.0:1788793195.989943:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788793195.989954:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8575:x1875685461232768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793195.992330:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8575:x1875685461232768:12345-0@lo:502:llog_process_th.0 Request processed in 2366us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793195.992347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788793195.993320:0:8575:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793195.993357:0:8575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8575:1875685461232768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793195.993415:0:8575:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788793195.993428:0:8575:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793195.993430:0:8575:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788793195.993438:0:8575:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff9264b9db6800 00000020:00000080:0.0:1788793195.993441:0:8575:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788793195.993562:0:8575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8575:1875685461232896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793195.993633:0:8575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793195.993669:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461232896 00000100:00100000:0.0:1788793195.993677:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461232896 00000100:00100000:0.0:1788793195.993727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788793195.993738:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8575:x1875685461232896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793196.001526:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:8575:x1875685461232896:12345-0@lo:502:llog_process_th.0 Request processed in 5320us (5424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793196.001547:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788793196.001661:0:8575:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 10 seconds 00000100:00100000:0.0:1788793196.001702:0:8575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8575:1875685461232896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788793196.001747:0:8575:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788793196.001757:0:8575:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788793196.001759:0:8575:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788793196.001765:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788793196.003342:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788793196.003382:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788793196.003404:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf39 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003420:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff926480030000/0xa112893a8a83cf32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf39 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788793196.003433:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788793196.003436:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff926488cd7800 from 4 10000000:01000000:0.0:1788793196.003439:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788793196.003489:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003498:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003510:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793196.003538:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788793196.003619:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793196.003661:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793196.003685:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233024 00000100:00100000:0.0:1788793196.003692:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233024 00000100:00100000:0.0:1788793196.003742:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788793196.003753:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+18:5832:x1875685461233024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793196.003780:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788793196.003796:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9264880f4400/0xa112893a8a83cf47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa112893a8a83cf40 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003839:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9264880f4400/0xa112893a8a83cf47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa112893a8a83cf40 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003851:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9264880f4400/0xa112893a8a83cf47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa112893a8a83cf40 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.003970:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9264880f4400, rc 0) 00000100:00100000:0.0:1788793196.004018:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461233024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 266us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793196.004025:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788793196.004216:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788793196.004231:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf47 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788793196.004241:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa112893a8a83cf47 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788793196.004296:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793196.004324:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793196.004341:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793196.004355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233152 00000100:00100000:0.0:1788793196.004358:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233152 00000100:00100000:0.0:1788793196.004381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788793196.004387:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461233152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793196.004691:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461233152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793196.004707:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788793196.004742:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788793196.005974:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788793196.006698:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788793196.006783:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9263824ff600 going to sleep for 11 seconds 00000100:00100000:1.0:1788793196.013276:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233280 00000100:00100000:1.0:1788793196.013299:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233280 00000100:00100000:1.0:1788793196.013547:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788793196.013561:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461233280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788793196.013913:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:5832:x1875685461233280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 355us (7214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793196.013923:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788793196.022977:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92649113d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:5832:1875685461233280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788793196.034086:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7140a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8578:1875685461233408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793196.034230:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793196.034281:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788793196.037953:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233408 00000100:00100000:3.0:1788793196.037975:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233408 00000100:00100000:3.0:1788793196.038068:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788793196.038081:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:8578:x1875685461233408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793196.038451:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264911d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:8578:x1875685461233408:12345-0@lo:502:llog_process_th.0 Request processed in 372us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793196.038460:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788793196.038542:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7140a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8578:1875685461233408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793196.038587:0:8578:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788793196.038599:0:8578:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793196.038602:0:8578:0:(obd_config.c:1547:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788793196.038611:0:8578:0:(obd_config.c:1988:class_config_llog_handler()) cmd ce032, instance name: general-ffff926488cd7800 00000020:00000080:3.0:1788793196.038613:0:8578:0:(obd_config.c:1456:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788793196.038731:0:8578:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7140a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8578:1875685461233536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788793196.038795:0:8578:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793196.038837:0:8578:0:(client.c:2716:ptlrpc_set_wait()) set ffff9264833c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1788793196.039216:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233536 00000100:00100000:0.0:1788793196.039223:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233536 00000100:00100000:0.0:1788793196.039262:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788793196.039271:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:8578:x1875685461233536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788793196.039476:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:8578:x1875685461233536:12345-0@lo:502:llog_process_th.0 Request processed in 205us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793196.039484:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788793196.039908:0:8578:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7140a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:8578:1875685461233536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788793196.039936:0:8578:0:(obd_config.c:1877:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788793196.039943:0:8578:0:(obd_config.c:1456:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788793196.039945:0:8578:0:(obd_config.c:1547:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788793196.039949:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788793196.040024:0:5832:0:(obd_config.c:2129:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788793196.040240:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788793196.040261:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf47 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793196.040277:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.106@tcp lock: ffff9264880f5400/0xa112893a8a83cf40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa112893a8a83cf47 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788793196.177991:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788793197.200422:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788793198.226400:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793198.551082:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793198.551117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793198.551136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793198.551170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793198.551194:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329856 00000100:00100000:3.0:1788793198.551202:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329856 00000100:00100000:3.0:1788793198.551245:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329728 00000100:00100000:3.0:1788793198.551246:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329728 00000100:00100000:3.0:1788793198.551258:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788793198.551265:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2368:x1875685442329856:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788793198.551332:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2368:x1875685442329856:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793198.551340:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 19 00000100:00100000:3.0:1788793198.551364:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788793198.551370:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2368:x1875685442329728:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788793198.551388:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2368:x1875685442329728:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 19us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793198.551392:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 20 00000100:00100000:3.0:1788793198.551403:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329472 00000100:00100000:3.0:1788793198.551414:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329472 00000100:00100000:3.0:1788793198.551429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00100000:3.0:1788793198.551433:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:2368:x1875685442329472:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788793198.551450:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:175113f2-5ecd-47e7-965d-37390a6514ab+10:2368:x1875685442329472:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 17us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793198.551454:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 193 00000100:00080000:3.0:1788793198.551476:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788793198.551480:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788793198.551652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329600 00000100:00100000:0.0:1788793198.551656:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329600 00000100:00100000:0.0:1788793198.551687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00100000:0.0:1788793198.551692:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:2368:x1875685442329600:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:0.0:1788793198.551715:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4e85697-afe4-4757-83c7-d2349c69909f+6:2368:x1875685442329600:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788793198.551729:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 34 00000100:00080000:3.0:1788793198.551967:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788793199.251808:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793199.377690:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461233664:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.377764:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.377806:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461234176:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.377832:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.377855:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788793199.377861:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461233792:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.377882:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.377899:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461234304:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.377921:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.377946:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.377968:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.377986:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788793199.377992:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b728d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234048:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378027:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788793199.378058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233664 00000100:00100000:2.0:1788793199.378065:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233664 00000100:00100000:2.0:1788793199.378109:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788793199.378118:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3310:x1875685461233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378183:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:73b0aaed-ca5a-4e64-8a6f-f63481662d2e+19:3310:x1875685461233664:12345-0@lo:400:kworker.0 Request processed in 66us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378191:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788793199.378224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461234176 00000100:00100000:2.0:1788793199.378228:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461234176 00000100:00100000:2.0:1788793199.378260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233792 00000100:00100000:2.0:1788793199.378263:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233792 00000100:00100000:2.0:1788793199.378274:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461233920 00000100:00100000:2.0:1788793199.378276:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461233920 00000100:00100000:2.0:1788793199.378304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788793199.378310:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461234176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875685461234176:12345-0@lo:400:kworker.0 Request processed in 47us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378363:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788793199.378496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788793199.378503:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461233792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378534:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875685461233792:12345-0@lo:400:kworker.0 Request processed in 32us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378539:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788793199.378551:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788793199.378557:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461233920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378587:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875685461233920:12345-0@lo:400:kworker.0 Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378593:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788793199.378611:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461234304 00000100:00100000:2.0:1788793199.378615:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461234304 00000100:00100000:2.0:1788793199.378640:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461234048 00000100:00100000:2.0:1788793199.378643:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461234048 00000100:00100000:2.0:1788793199.378658:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793199.378663:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461234304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378692:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875685461234304:12345-0@lo:400:kworker.0 Request processed in 29us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378699:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788793199.378710:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788793199.378716:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378754:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234048:12345-0@lo:400:kworker.0 Request processed in 38us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788793199.378760:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788793199.378782:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788793199.378786:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788793199.378789:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788793199.378817:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b728d880 x1875685461234048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793199.378830:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234048:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378841:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875685461233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378871:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875685461233792:0@lo:400:kworker.0 00010000:00080000:2.0:1788793199.378881:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b728ea00 x1875685461234304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788793215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788793199.378890:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875685461234304:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378898:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:73b0aaed-ca5a-4e64-8a6f-f63481662d2e:3310:1875685461233664:0@lo:400:kworker.0 00000100:00100000:2.0:1788793199.378907:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b728f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875685461234176:0@lo:400:kworker.0 00000100:00100000:1.0:1788793199.895905:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788793199.895977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788793199.896376:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461234432 00000100:00100000:1.0:1788793199.896385:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461234432 00000100:00100000:1.0:1788793199.896471:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788793199.896482:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b6071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788793199.896515:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788793199.896564:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b6071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793199.896572:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788793199.897615:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b7143480 x1875685461234432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788793199.897638:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788793200.272722:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793200.923437:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788793200.923461:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9264b7142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788793200.923531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788793200.923606:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685461234560 00000100:00100000:3.0:1788793200.923614:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685461234560 00000100:00100000:3.0:1788793200.923664:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788793200.923673:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788793200.923707:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788793200.923754:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875685461234560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793200.923762:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788793200.923804:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9264b7142a00 x1875685461234560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788793216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788793200.923823:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9264b7142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875685461234560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788793201.300267:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788793201.403380:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg106-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788793202.320387:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788793203.349194:0:7632:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788793203.684746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793203.684808:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:1.0:1788793203.684900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442329984 00000100:00100000:1.0:1788793203.684913:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442329984 00000100:00100000:1.0:1788793203.684987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:1.0:1788793203.684997:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:2366:x1875685442329984:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:1.0:1788793203.685083:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264884d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:175113f2-5ecd-47e7-965d-37390a6514ab+10:2366:x1875685442329984:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788793203.685109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 195 00000100:00100000:3.0:1788793203.685689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442330112 00000100:00100000:3.0:1788793203.685695:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442330112 00000100:00100000:3.0:1788793203.685743:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00100000:3.0:1788793203.685758:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:2366:x1875685442330112:12345-192.168.201.6@tcp:400:kworker.0 00000100:00100000:3.0:1788793203.685818:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4e85697-afe4-4757-83c7-d2349c69909f+6:2366:x1875685442330112:12345-192.168.201.6@tcp:400:kworker.0 Request processed in 62us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793203.685826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 38 00000100:00080000:2.0:1788793203.685881:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788793203.693353:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:2.0:1788793203.693428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.6@tcp (source: 12345-192.168.201.6@tcp) 00000100:00100000:3.0:1788793203.693545:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442330240 00000100:00100000:3.0:1788793203.693558:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442330240 00000100:00100000:3.0:1788793203.693655:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875685442330368 00000100:00100000:3.0:1788793203.693659:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875685442330368 00000100:00100000:3.0:1788793203.693682:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 10 00000100:00100000:3.0:1788793203.693693:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2364:x1875685442330240:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1788793203.693751:0:6686:0:(genops.c:1458:class_disconnect()) disconnect: cookie 0xa112893a8a83ce83 00000100:00080000:3.0:1788793203.693767:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9264bf301800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788793203.693815:0:6686:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788793203.694040:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788793203.694339:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+1:2364:x1875685442330240:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 647us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793203.694349:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 10 00000020:00000080:3.0:1788793203.694360:0:6686:0:(genops.c:885:class_export_put()) final put ffff9264bf307000/d4e85697-afe4-4757-83c7-d2349c69909f 00000100:00100000:3.0:1788793203.694384:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.6@tcp, seq: 11 00000100:00100000:3.0:1788793203.694392:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9264b728ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+5:2364:x1875685442330368:12345-192.168.201.6@tcp:9:kworker.0 00000020:00000080:3.0:1788793203.694410:0:6686:0:(genops.c:1458:class_disconnect()) disconnect: cookie 0xa112893a8a83ce8a 00000100:00080000:3.0:1788793203.694418:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9264bf307800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788793203.694441:0:6686:0:(tgt_lastrcvd.c:725:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788793203.694644:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9264b728ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4e85697-afe4-4757-83c7-d2349c69909f+1:2364:x1875685442330368:12345-192.168.201.6@tcp:9:kworker.0 Request processed in 251us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788793203.694651:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.6@tcp, seq: 11 00000020:00000080:3.0:1788793203.694657:0:6686:0:(genops.c:885:class_export_put()) final put ffff9264bf302000/d4e85697-afe4-4757-83c7-d2349c69909f 00000020:00000080:3.0:1788793203.694764:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9264bf307000/d4e85697-afe4-4757-83c7-d2349c69909f for lustre-OST0000 00010000:00040000:3.0:1788793203.694783:0:38:0:(ldlm_lib.c:1799:target_destroy_export()) ASSERTION( atomic_read(&exp->exp_cb_count) == 0 ) failed: 00010000:00010000:1.0:1788793203.694828:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788793203.697996:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788793203.698010:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00040000:3.0:1788793203.703996:0:38:0:(ldlm_lib.c:1799:target_destroy_export()) LBUG Debug log: 6417 lines, 6417 kept, 0 dropped, 0 bad.