00000001:02000400:1.0F:1790770244.883134:0:2971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1790770264.235636:0:3198:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1790770266.529877:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 571 MB/s 00000001:01000000:2.0:1790770266.780655:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 458 MB/s 00000001:01000000:3.0F:1790770267.034930:0:3257:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 1917 MB/s 00000020:02000000:2.0:1790770267.831355:0:3290:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_gf57cca5 00000400:02000000:0.0:1790770269.016058:0:3305:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.126@tcp [8/256/0/180] 00008000:02000000:2.0:1790770273.217534:0:3454:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790770328.709448:0:5266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790770339.445276:0:5839:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790770339.445283:0:5839:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1790770339.445569:0:5839:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007bd16b48 00000080:02000400:0.0:1790770339.445580:0:5839:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:0.0:1790770339.455992:0:5839:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1790770339.456007:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790770339.456053:0:5839:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d18eb11f) 00000020:00000080:0.0:1790770339.456076:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790770339.499059:0:5839:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790770339.503242:0:5839:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1790770339.556198:0:5839:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790770339.556637:0:5839:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790770339.556741:0:5839:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790770339.556799:0:5839:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790770339.556986:0:5839:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790770339.557536:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1790770339.557544:0:5839:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790770339.557555:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86cff 00000020:01000004:2.0:1790770339.557563:0:5839:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1790770339.557567:0:5839:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1790770339.557572:0:5839:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007bd16b48 from MGS 00000020:01000004:2.0:1790770339.557576:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1790770339.557593:0:5839:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f902a9a9) 00000020:00000080:2.0:1790770339.557605:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1790770339.557928:0:5839:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007bd16b48 from MGS, refs=2 00080000:01000000:2.0:1790770339.557934:0:5839:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790770339.558107:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86d0d 00000100:00100000:0.0:1790770339.558542:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790770339.559018:0:5839:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790770339.559027:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790770339.560397:0:5839:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790770339.560477:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790770339.561676:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790770339.561890:0:5839:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790770339.561896:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790770339.563093:0:5839:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790770339.563104:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790770339.569223:0:5839:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790770339.569237:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790770339.570787:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.570792:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.570794:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.571589:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.571593:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.571595:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770339.572395:0:5839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790770339.577644:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790770339.823245:0:5839:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1669 MB/s 00000001:01000000:3.0:1790770340.073146:0:5839:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1751 MB/s 00000001:01000000:1.0:1790770340.324009:0:5839:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 318 MB/s 00000001:01000000:2.0:1790770340.577637:0:5839:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 434 MB/s 00080000:10000000:1.0:1790770340.607426:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1790770340.630155:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1790770340.657236:0:5839:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790770340.657269:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790770340.657273:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790770340.664111:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790770340.664205:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790770340.664274:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1790770340.664537:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1790770340.664564:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1790770340.669558:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790770340.669761:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1790770340.669776:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790770340.670660:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790770340.670669:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790770340.671346:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790770340.671354:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1790770340.673685:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790770340.673710:0:5839:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.126@tcp' 00000020:01000004:2.0:1790770340.673712:0:5839:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790770340.673768:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.126@tcp (typ=mgc) 00000020:00000080:2.0:1790770340.673779:0:5839:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.126@tcp (00000000e7d08c86) 00000020:00000080:2.0:1790770340.673796:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790770340.673912:0:5839:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000088fc1b35@MGC192.168.204.126@tcp: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1790770340.674095:0:5839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.126@tcp-0 is initialized 00000040:01000000:2.0:1790770340.674102:0:5839:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790770340.676634:0:5854:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790770340.689718:0:5855:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790770340.689778:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.126@tcp (uuid c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3) 00000020:00000080:1.0:1790770340.689818:0:5839:0:(genops.c:1384:class_connect()) connect: client c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3, cookie 0x7379b1d471b86d1b 00000100:00080000:1.0:1790770340.689833:0:5839:0:(import.c:545:import_select_connection()) MGC192.168.204.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790770340.689845:0:5839:0:(import.c:666:import_select_connection()) MGC192.168.204.126@tcp: import 0000000088fc1b35 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1790770340.689925:0:5839:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c1778aed x1877758725587072/t0(0) o250->MGC192.168.204.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790770340.690012:0:5839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3->MGS 00000020:01000004:1.0:1790770340.690031:0:5839:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790770340.690036:0:5839:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790770340.690056:0:5839:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cea574af) 00000020:00000080:1.0:1790770340.690068:0:5839:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790770340.692180:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1778aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3320:1877758725587072:0@lo:250: 00000100:00100000:2.0:1790770340.692302:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770340.692475:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587072 00000100:00100000:0.0:1790770340.692485:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587072 00000100:00100000:0.0:1790770340.692525:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770340.692532:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002591f1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3320:x1877758725587072:12345-0@lo:250: 00010000:00080000:0.0:1790770340.692559:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1790770340.692597:0:5851:0:(genops.c:1384:class_connect()) connect: client c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3, cookie 0x7379b1d471b86d29 00000100:00080000:0.0:1790770340.692737:0:5851:0:(import.c:65:import_set_state_nolock()) 000000005ce9d2cb : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790770340.692833:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002591f1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:3320:x1877758725587072:12345-0@lo:250: Request processed in 300us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770340.692841:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790770340.693152:0:3320:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790770340.693161:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1790770340.693169:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790770340.693174:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790770340.693177:0:3320:0:(import.c:65:import_set_state_nolock()) 0000000088fc1b35 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790770340.693180:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790770340.693197:0:3320:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790770340.693203:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1778aed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3320:1877758725587072:0@lo:250: 00000100:00100000:0.0:1790770340.715487:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790770340.715723:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790770340.715730:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1790770340.718596:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1790770340.718613:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790770340.727191:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790770340.727207:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790770340.734684:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790770340.734922:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790770340.734928:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790770340.735581:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790770340.735591:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1790770340.808303:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790770340.808574:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1790770340.808580:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790770340.810609:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790770340.810621:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790770340.811363:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790770340.811548:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790770340.811558:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790770340.812615:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790770340.812624:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1790770340.813149:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790770340.813315:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1790770340.813319:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790770340.816479:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790770340.816496:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790770340.817395:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790770340.817575:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790770340.817580:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1790770340.818568:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790770340.818578:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790770341.076537:0:5839:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790770341.076783:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790770341.076800:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790770341.078976:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790770341.078991:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790770341.111233:0:5839:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790770341.111260:0:5839:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790770341.112924:0:5839:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790770341.112975:0:5839:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790770341.112982:0:5839:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790770341.113447:0:5839:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790770341.113490:0:5839:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1790770341.113494:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790770341.113497:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790770341.113498:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790770341.113499:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790770341.113500:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790770341.113502:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790770341.113503:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790770341.113504:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790770341.113506:0:5839:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790770341.113510:0:5839:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790770341.113512:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790770341.113513:0:5839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790770341.113515:0:5839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1790770341.113517:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790770341.113518:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790770341.113519:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790770341.113520:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790770341.113521:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790770341.113522:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790770341.113522:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790770341.113523:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790770341.113524:0:5839:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790770341.113525:0:5839:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790770341.113526:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790770341.113526:0:5839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790770341.113571:0:5839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790770341.113593:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587200:0@lo:253: 00000100:00100000:3.0:1790770341.113711:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770341.113867:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587200 00000100:00100000:0.0:1790770341.113875:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587200 00000100:00100000:3.0:1790770341.113918:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000001111d83f going to sleep for 11 seconds 00000100:00100000:0.0:1790770341.125507:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790770341.125529:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e2196d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5839:x1877758725587200:12345-0@lo:253: 20000000:01000000:0.0:1790770341.125598:0:5853:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790770341.125601:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790770341.126703:0:5874:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790770341.126790:0:5853:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790770341.128581:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790770341.130660:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1790770341.133770:0:5853:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790770341.133778:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1790770341.133787:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1790770341.133791:0:5853:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1790770341.133806:0:5853:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1790770341.134344:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790770341.135225:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1790770341.135251:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1790770341.135314:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1790770341.135380:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1790770341.135420:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1790770341.136224:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1790770341.136234:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1790770341.136290:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1790770341.136299:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1790770341.136331:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1790770341.136351:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1790770341.136386:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1790770341.136552:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1790770341.136591:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790770341.136598:0:5853:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1790770341.136611:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790770341.137544:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1790770341.137562:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790770341.137621:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1790770341.137656:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1790770341.137722:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1790770341.137739:0:5853:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1790770341.137826:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1790770341.137835:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790770341.138264:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1790770341.138303:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1790770341.138336:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1790770341.138348:0:5853:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1790770341.138603:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1790770341.138614:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1790770341.138647:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1790770341.138683:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1790770341.138836:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1790770341.138936:0:5853:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1790770341.139071:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1790770341.144977:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790770341.145645:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790770341.145679:0:5853:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.126@tcp for mdt 20000000:01000000:0.0:1790770341.145682:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1790770341.145719:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790770341.145727:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790770341.145754:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790770341.145760:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1790770341.145804:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790770341.145814:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790770341.145859:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790770341.145897:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790770341.146000:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790770341.146003:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790770341.146009:0:5853:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790770341.146016:0:5853:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1790770341.147287:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1790770341.147480:0:5853:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790770341.161029:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790770341.164367:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1790770341.164460:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1790770341.164481:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790770341.164484:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790770341.164487:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790770341.164501:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790770341.164503:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790770341.164542:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790770341.164544:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790770341.167553:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1790770341.167928:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1790770341.168015:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1790770341.168052:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1790770341.168068:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790770341.168071:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790770341.171396:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1790770341.171855:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1790770341.171903:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1790770341.172015:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1790770341.172030:0:5853:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790770341.172032:0:5853:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790770341.172038:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790770341.172056:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172072:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172081:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172087:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172094:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172100:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172113:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2173b67 already unused, calling callback (00000000f8758765) 00010000:00010000:0.0:1790770341.172116:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172124:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172137:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172144:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.172149:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d30 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790770341.172168:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790770341.619501:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e2196d0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5839:x1877758725587200:12345-0@lo:253: Request processed in 493976us (505783us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770341.619523:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790770341.619626:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587200:0@lo:253: 10000000:01000000:3.0:1790770341.619641:0:5839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790770341.619644:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790770341.619646:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790770341.619647:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790770341.619648:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1790770341.619649:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790770341.619650:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790770341.619652:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790770341.619653:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790770341.619655:0:5839:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790770341.619656:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790770341.619657:0:5839:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790770341.619677:0:5839:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007bd16b48 from lustre-MDT0000 10000000:01000000:3.0:1790770341.619703:0:5839:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1790770341.619706:0:5839:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790770341.619710:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92c1e2b94d40 10000000:01000000:3.0:1790770341.619715:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790770341.619723:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92c1e2b94d40 from 1 10000000:01000000:3.0:1790770341.619727:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790770341.619765:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.619776:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.619785:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770341.619820:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587328:0@lo:101: 00000100:00100000:3.0:1790770341.619880:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770341.619975:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770341.620058:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587328 00000100:00100000:0.0:1790770341.620065:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587328 00000100:00100000:0.0:1790770341.620095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790770341.620101:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000073ed7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5839:x1877758725587328:12345-0@lo:101: 00010000:00010000:0.0:1790770341.620113:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770341.620124:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86d37 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.620143:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.620152:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2173b67/0x7379b1d471b86d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.620166:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2173b67, rc 0) 00000100:00100000:0.0:1790770341.620202:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000073ed7caf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5839:x1877758725587328:12345-0@lo:101: Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770341.620208:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790770341.620303:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587328:0@lo:101: 00010000:00010000:3.0:1790770341.620316:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.620324:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770341.620370:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587456:0@lo:501: 00000100:00100000:3.0:1790770341.620394:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770341.620459:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770341.620496:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587456 00000100:00100000:1.0:1790770341.620500:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587456 00000100:00100000:1.0:1790770341.620570:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790770341.620576:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000041503ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5839:x1877758725587456:12345-0@lo:501: 00000100:00100000:1.0:1790770341.620829:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000041503ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5839:x1877758725587456:12345-0@lo:501: Request processed in 254us (435us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790770341.620846:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790770341.620907:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587456:0@lo:501: 10000000:01000000:3.0:1790770341.620932:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790770341.620971:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.620979:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000001e7214e2/0x7379b1d471b86d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770341.620986:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92c1c64e1000 10000000:01000000:3.0:1790770341.620991:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790770341.620995:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92c1c64e1000 10000000:01000000:3.0:1790770341.620998:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790770341.621000:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92c1c64e1000 from 1 10000000:01000000:3.0:1790770341.621009:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790770341.621026:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.621033:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.621040:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770341.621051:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587584:0@lo:101: 00000100:00100000:3.0:1790770341.621076:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770341.623077:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587584 00000100:00100000:0.0:1790770341.623093:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587584 00000100:00100000:0.0:1790770341.623511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790770341.623523:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001e606a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5839:x1877758725587584:12345-0@lo:101: 00010000:00010000:0.0:1790770341.623543:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770341.623564:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c75f6743/0x7379b1d471b86d4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86d45 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.623593:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c75f6743/0x7379b1d471b86d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86d45 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.623603:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c75f6743/0x7379b1d471b86d4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86d45 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770341.623611:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c75f6743, rc 0) 00000100:00100000:3.0:1790770341.624266:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770341.624709:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001e606a21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+7:5839:x1877758725587584:12345-0@lo:101: Request processed in 1187us (3631us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770341.624726:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790770341.626047:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587584:0@lo:101: 00010000:00010000:3.0:1790770341.626083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.626093:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86d4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770341.626120:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790770341.626140:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.626148:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000874ff52f/0x7379b1d471b86d45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770341.626157:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790770341.626164:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790770341.626170:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92c1c64e1000 10000000:01000000:3.0:1790770341.626191:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790770341.626195:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790770341.626197:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790770341.626228:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.626234:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.626241:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770341.626258:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587712:0@lo:101: 00000100:00100000:3.0:1790770341.626312:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770341.626344:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587712 00000100:00100000:3.0:1790770341.626344:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770341.626351:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587712 00000100:00100000:2.0:1790770341.626388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790770341.626396:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002f56405c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+7:5839:x1877758725587712:12345-0@lo:101: 00010000:00010000:2.0:1790770341.626411:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770341.626423:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ada7da2/0x7379b1d471b86d5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86d53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770341.626456:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ada7da2/0x7379b1d471b86d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770341.626465:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ada7da2/0x7379b1d471b86d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770341.626473:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ada7da2, rc 0) 00000100:00100000:2.0:1790770341.626536:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002f56405c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+8:5839:x1877758725587712:12345-0@lo:101: Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770341.626542:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790770341.627885:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587712:0@lo:101: 00010000:00010000:3.0:1790770341.627907:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770341.627917:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770341.628023:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587840:0@lo:501: 00000100:00100000:3.0:1790770341.628064:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770341.628092:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770341.628162:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587840 00000100:00100000:2.0:1790770341.628168:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587840 00000100:00100000:2.0:1790770341.628199:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790770341.628205:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000759791ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+8:5839:x1877758725587840:12345-0@lo:501: 00000100:00100000:2.0:1790770341.628492:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000759791ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5839:x1877758725587840:12345-0@lo:501: Request processed in 277us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770341.628500:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790770341.628624:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587840:0@lo:501: 00000100:00100000:3.0:1790770341.628652:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587968:0@lo:503: 00000100:00100000:3.0:1790770341.628703:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770341.628735:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cceef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770341.628967:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725587968 00000100:00100000:2.0:1790770341.628972:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725587968 00000100:00100000:2.0:1790770341.628992:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790770341.628997:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000002c0c14cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5839:x1877758725587968:12345-0@lo:503: 00000100:00100000:2.0:1790770341.629143:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000002c0c14cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5839:x1877758725587968:12345-0@lo:503: Request processed in 146us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770341.629149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790770341.629515:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cf95f29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725587968:0@lo:503: 00000100:00100000:2.0:1790770341.630079:0:5881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5881:1877758725588096:0@lo:502: 00000100:00100000:2.0:1790770341.630120:0:5881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770341.630148:0:5881:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3de18f2 going to sleep for 11 seconds 00000100:00100000:1.0:1790770341.630194:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588096 00000100:00100000:1.0:1790770341.630199:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588096 00000100:00100000:1.0:1790770341.630267:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790770341.630272:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005a86d819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5881:x1877758725588096:12345-0@lo:502: 00000100:00100000:1.0:1790770341.630466:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005a86d819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5881:x1877758725588096:12345-0@lo:502: Request processed in 194us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770341.630472:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790770341.630553:0:5881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5881:1877758725588096:0@lo:502: 00000020:01000000:2.0:1790770341.630575:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790770341.630586:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770341.630588:0:5881:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790770341.630593:0:5881:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790770341.630596:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790770341.630607:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a4b8b873) 00000020:00000080:2.0:1790770341.630625:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790770341.630630:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790770341.630719:0:5881:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790770341.630725:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86d68 00000020:00000080:2.0:1790770341.630991:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790770341.630995:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790770341.630999:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770341.631001:0:5881:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790770341.631003:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790770341.631007:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770341.631008:0:5881:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790770341.631011:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790770341.631018:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e0827f85) 00000020:00000080:2.0:1790770341.631027:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790770341.631031:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790770341.631032:0:5881:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790770341.631035:0:5881:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790770341.631040:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790770341.631083:0:5881:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007bd16b48 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790770341.631099:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002c1d3c40) 00000020:00000080:2.0:1790770341.631106:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790770341.631149:0:5881:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790770341.631156:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7379b1d471b86d7d 00000020:00000080:2.0:1790770341.631247:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790770341.631254:0:5881:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790770341.631258:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7379b1d471b86d84 00080000:01000000:2.0:1790770341.631262:0:5881:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790770341.631265:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86d8b 00080000:10000000:2.0:1790770341.631681:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1790770341.631896:0:5881:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1790770341.638927:0:5881:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790770341.654274:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770341.993439:0:5881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1790770341.993851:0:5881:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1790770342.002213:0:5881:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1790770342.002529:0:5881:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790770342.106818:0:5881:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d97e9973) 00000020:00000080:0.0:1790770342.106864:0:5881:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790770342.111391:0:5881:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790770342.111407:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86d99 00000020:00000080:0.0:1790770342.112567:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1790770342.115253:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790770342.187905:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.292815:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790770342.377737:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.435866:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.504311:0:5881:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1790770342.559193:0:5881:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7379b1d471b86da0 00000020:00000080:1.0:1790770342.559421:0:5881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790770342.559433:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790770342.559438:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770342.559440:0:5881:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790770342.559444:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790770342.559449:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770342.559450:0:5881:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790770342.559454:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790770342.559486:0:5881:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790770342.559499:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790770342.559502:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770342.559504:0:5881:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790770342.559506:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790770342.559509:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770342.559510:0:5881:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790770342.559513:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790770342.559514:0:5881:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790770342.559560:0:5881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3b2d053 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5881:1877758725588224:0@lo:502: 00000100:00100000:1.0:1790770342.559640:0:5881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770342.559692:0:5881:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a113d59 going to sleep for 11 seconds 00000100:00100000:1.0:1790770342.559714:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588224 00000100:00100000:1.0:1790770342.559720:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588224 00000100:00100000:1.0:1790770342.559758:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790770342.559765:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d73332a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5881:x1877758725588224:12345-0@lo:502: 00000100:00100000:1.0:1790770342.566736:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d73332a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5881:x1877758725588224:12345-0@lo:502: Request processed in 6959us (7084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770342.566754:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790770342.567029:0:5881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3b2d053 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5881:1877758725588224:0@lo:502: 00000020:01000000:0.0:1790770342.567069:0:5881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790770342.567077:0:5881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770342.567079:0:5881:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790770342.567083:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1790770342.567271:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1790770342.567306:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790770342.567375:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.567386:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000c5c161b0/0x7379b1d471b86d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770342.567394:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92c1c64e1000 from 1 10000000:01000000:1.0:1790770342.567396:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790770342.567445:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.567453:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.567460:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770342.567490:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df42e836 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588352:0@lo:101: 00000100:00100000:1.0:1790770342.567529:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770342.567570:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a113d59 going to sleep for 11 seconds 00000100:00100000:0.0:1790770342.567745:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588352 00000100:00100000:0.0:1790770342.567754:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588352 00000100:00100000:0.0:1790770342.567805:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790770342.567813:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f2602667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:5839:x1877758725588352:12345-0@lo:101: 00010000:00010000:0.0:1790770342.567835:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770342.567848:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86da7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.567873:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.567883:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.567891:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001477d2f9, rc 0) 00000100:00100000:0.0:1790770342.567924:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f2602667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:5839:x1877758725588352:12345-0@lo:101: Request processed in 112us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770342.567930:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790770342.568130:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df42e836 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588352:0@lo:101: 00010000:00010000:1.0:1790770342.568143:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.568151:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770342.568900:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df42e836 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588480:0@lo:256: 00000100:00100000:0.0:1790770342.570774:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770342.570849:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a113d59 going to sleep for 11 seconds 00000100:00100000:1.0:1790770342.570907:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588480 00000100:00100000:1.0:1790770342.570917:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588480 00000100:00100000:1.0:1790770342.570996:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790770342.571005:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005bd4e357 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:5839:x1877758725588480:12345-0@lo:256: 20000000:01000000:1.0:1790770342.571029:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790770342.571035:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790770342.571133:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005bd4e357 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:5839:x1877758725588480:12345-0@lo:256: Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770342.571141:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790770342.571328:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df42e836 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588480:0@lo:256: 10000000:01000000:2.0:1790770342.572207:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790770342.572229:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.572240:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770342.572249:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92c1c64e1000 from 1 10000000:01000000:2.0:1790770342.572252:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790770342.572292:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.572299:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.572308:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770342.572326:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588608:0@lo:101: 00000100:00100000:2.0:1790770342.572382:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770342.572716:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588608 00000100:00100000:1.0:1790770342.572725:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588608 00000100:00100000:1.0:1790770342.572772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790770342.572779:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005fb28db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:5839:x1877758725588608:12345-0@lo:101: 00010000:00010000:1.0:1790770342.572793:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770342.572808:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86db5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.572841:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.572850:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770342.572859:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c76de60, rc 0) 00000100:00100000:1.0:1790770342.574082:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005fb28db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588608:12345-0@lo:101: Request processed in 1300us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770342.574092:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790770342.574378:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092c1a14f going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.574404:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588608:0@lo:101: 00010000:00010000:2.0:1790770342.574437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.574447:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770342.574525:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588736:0@lo:501: 00000100:00100000:2.0:1790770342.574569:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.574583:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092c1a14f going to sleep for 11 seconds 00000100:00100000:1.0:1790770342.574782:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588736 00000100:00100000:1.0:1790770342.574797:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588736 00000100:00100000:1.0:1790770342.574846:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790770342.574853:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e713832e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588736:12345-0@lo:501: 00000100:00100000:1.0:1790770342.575366:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e713832e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588736:12345-0@lo:501: Request processed in 513us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770342.575375:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790770342.575616:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588736:0@lo:501: 00000100:00100000:2.0:1790770342.575650:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588864:0@lo:503: 00000100:00100000:2.0:1790770342.575689:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.575721:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092c1a14f going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.575737:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588864 00000100:00100000:2.0:1790770342.575742:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588864 00000100:00100000:2.0:1790770342.575764:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790770342.575770:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001ec9592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588864:12345-0@lo:503: 00000040:00080000:2.0:1790770342.575813:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790770342.575865:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001ec9592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588864:12345-0@lo:503: Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770342.575872:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790770342.575908:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588864:0@lo:503: 00000040:00080000:2.0:1790770342.576599:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790770342.576661:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790770342.576677:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790770342.576694:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.576704:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770342.576740:0:5839:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790770342.576742:0:5839:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92c1c64e1000 10000000:01000000:2.0:1790770342.576745:0:5839:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92c1c64e1000 10000000:01000000:2.0:1790770342.576748:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790770342.576754:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1c64e1000 from 1 10000000:01000000:2.0:1790770342.576756:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790770342.576780:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.576787:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.576795:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770342.576808:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588992:0@lo:101: 00000100:00100000:2.0:1790770342.576850:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.576866:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b65bc3b going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.576881:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725588992 00000100:00100000:2.0:1790770342.576886:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725588992 00000100:00100000:2.0:1790770342.576907:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790770342.576913:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000004b0f0a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725588992:12345-0@lo:101: 00010000:00010000:2.0:1790770342.576932:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770342.576964:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e7d2b568/0x7379b1d471b86dca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86dc3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.576983:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e7d2b568/0x7379b1d471b86dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.576992:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e7d2b568/0x7379b1d471b86dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.577000:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e7d2b568, rc 0) 00000100:00100000:2.0:1790770342.577029:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000004b0f0a1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725588992:12345-0@lo:101: Request processed in 117us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770342.577036:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790770342.577080:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725588992:0@lo:101: 00010000:00010000:2.0:1790770342.577093:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.577100:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770342.577138:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589120:0@lo:501: 00000100:00100000:2.0:1790770342.577160:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.577173:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b65bc3b going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.577185:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589120 00000100:00100000:2.0:1790770342.577188:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589120 00000100:00100000:2.0:1790770342.577204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790770342.577209:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000097cff2e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725589120:12345-0@lo:501: 00000100:00100000:2.0:1790770342.577437:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000097cff2e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725589120:12345-0@lo:501: Request processed in 228us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770342.577444:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790770342.577469:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589120:0@lo:501: 00000100:00100000:2.0:1790770342.577489:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589248:0@lo:503: 00000100:00100000:2.0:1790770342.577518:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.577529:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b65bc3b going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.577539:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589248 00000100:00100000:2.0:1790770342.577542:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589248 00000100:00100000:2.0:1790770342.577556:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790770342.577560:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009f82982e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725589248:12345-0@lo:503: 00000100:00100000:0.0:1790770342.585430:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d9fe53b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589248:0@lo:503: 00000100:00100000:2.0:1790770342.585858:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009f82982e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725589248:12345-0@lo:503: Request processed in 7709us (7751us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770342.585871:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790770342.586132:0:5886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5886:1877758725589376:0@lo:502: 00000100:00100000:1.0:1790770342.586184:0:5886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770342.586236:0:5886:0:(client.c:2716:ptlrpc_set_wait()) set 00000000105378aa going to sleep for 11 seconds 00000100:00100000:0.0:1790770342.586733:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589376 00000100:00100000:0.0:1790770342.586743:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589376 00000100:00100000:0.0:1790770342.586792:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790770342.586800:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bc67e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5886:x1877758725589376:12345-0@lo:502: 00000100:00100000:0.0:1790770342.587211:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bc67e54d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5886:x1877758725589376:12345-0@lo:502: Request processed in 412us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770342.587220:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790770342.587344:0:5886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5886:1877758725589376:0@lo:502: 00000020:01000004:1.0:1790770342.587403:0:5886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1790770342.587429:0:5886:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000de763eb4) 00000020:00000080:1.0:1790770342.587463:0:5886:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1790770342.587556:0:5886:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007bd16b48 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790770342.587559:0:5886:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007bd16b48 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1790770342.587561:0:5886:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007bd16b48 4 00010000:00080000:1.0:1790770342.587590:0:5886:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a6d3ec2d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1790770342.589309:0:5886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1790770342.591775:0:5886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790770342.591832:0:5886:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790770342.591846:0:5886:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7379b1d471b86dd8 00000100:00080000:0.0:1790770342.591857:0:5886:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790770342.591869:0:5886:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a6d3ec2d using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1790770342.591927:0:5886:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000adb0f39f x1877758725589504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790770342.591975:0:5886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790770342.592122:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adb0f39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1877758725589504:0@lo:38: 00000100:00100000:2.0:1790770342.592200:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770342.592315:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589504 00000100:00100000:0.0:1790770342.592322:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589504 00000100:00100000:0.0:1790770342.592495:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770342.592502:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9718d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1877758725589504:12345-0@lo:38: 00000100:00100000:0.0:1790770342.592562:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9718d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1877758725589504:12345-0@lo:38: Request processed in 59us (362us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790770342.592569:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790770342.596637:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790770342.596650:0:3320:0:(import.c:65:import_set_state_nolock()) 00000000a6d3ec2d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790770342.596658:0:3320:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790770342.596661:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adb0f39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1877758725589504:0@lo:38: 00000100:00100000:1.0:1790770342.603212:0:5886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5886:1877758725589632:0@lo:502: 00000100:00100000:1.0:1790770342.603304:0:5886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770342.603347:0:5886:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b486db7e going to sleep for 11 seconds 00000100:00100000:2.0:1790770342.603399:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589632 00000100:00100000:2.0:1790770342.603418:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589632 00000100:00100000:2.0:1790770342.603482:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790770342.603490:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cc110d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5886:x1877758725589632:12345-0@lo:502: 00000100:00100000:2.0:1790770342.603898:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cc110d1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5886:x1877758725589632:12345-0@lo:502: Request processed in 408us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770342.603913:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790770342.604104:0:5886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5886:1877758725589632:0@lo:502: 00000040:00080000:1.0:1790770342.604128:0:5886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790770342.604382:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790770342.604414:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790770342.604434:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.604444:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 00000000a87b6dd0/0x7379b1d471b86dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790770342.605718:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790770342.605721:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790770342.605723:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770342.605724:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770342.605725:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770342.605727:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770342.605728:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790770342.605730:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790770342.605731:0:5839:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770342.605733:0:5839:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770342.605735:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770342.605736:0:5839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790770342.605739:0:5839:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790770342.605742:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790770342.605744:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790770342.605745:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770342.605746:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770342.605747:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770342.605749:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770342.605749:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790770342.605750:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790770342.605751:0:5839:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770342.605752:0:5839:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770342.605753:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770342.605754:0:5839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790770342.605775:0:5839:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790770342.605790:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010dc53ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589760:0@lo:253: 00000100:00100000:2.0:1790770342.605864:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.605895:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3de18f2 going to sleep for 11 seconds 00000100:00100000:3.0:1790770342.606517:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589760 00000100:00100000:3.0:1790770342.606528:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589760 00000100:00100000:3.0:1790770342.606594:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790770342.606794:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f05ae9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5839:x1877758725589760:12345-0@lo:253: 20000000:01000000:3.0:1790770342.606833:0:5852:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790770342.606847:0:5852:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790770342.653382:0:5852:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790770342.653412:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790770342.653573:0:5874:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790770342.653579:0:5874:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790770342.653613:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.653637:0:5874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.653646:0:5874:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.653691:0:5874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770342.653708:0:5874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 12 pid: 5851 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770342.653723:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ab9d396c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725589888:0@lo:104: 00000100:00100000:2.0:1790770342.653786:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770342.653860:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 000000004cecc6f3 going to sleep for 11 seconds 00000100:00100000:0.0:1790770342.654881:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725589888 00000100:00100000:0.0:1790770342.654893:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725589888 00000100:00100000:0.0:1790770342.654987:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770342.654996:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ca17e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725589888:12345-0@lo:104: 00010000:00010000:0.0:1790770342.655012:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655087:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790770342.655093:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ca17e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725589888:12345-0@lo:104: Request processed in 99us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770342.655100:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790770342.655121:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790770342.655126:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655134:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000097414515 already unused, calling callback (000000006903dfb8) 10000000:00010000:0.0:1790770342.655137:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655145:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790770342.655151:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790770342.655156:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790770342.655189:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655195:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790770342.655214:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655231:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 0000000097414515/0x7379b1d471b86da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dae expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655249:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770342.655251:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770342.655253:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770342.655580:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725590016:0@lo:103: 00000100:00100000:0.0:1790770342.655699:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770342.655784:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590016 00000100:00100000:0.0:1790770342.655791:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590016 00010000:00010000:0.0:1790770342.655811:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 13 pid: 5851 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770342.655851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770342.655858:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003d08eaeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3322:x1877758725590016:12345-0@lo:103: 00010000:00010000:0.0:1790770342.655869:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790770342.655874:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 13 pid: 5851 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655884:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 13 pid: 5851 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655900:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655908:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790770342.655923:0:5843:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002344850s 00010000:00010000:0.0:1790770342.655934:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655976:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655983:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655989:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.655994:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b5903b3 already unused, calling callback (00000000f8758765) 00010000:00010000:0.0:1790770342.655998:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656005:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656013:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656023:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790770342.656054:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003d08eaeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3322:x1877758725590016:12345-0@lo:103: Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770342.656060:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790770342.656108:0:5874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001477d2f9/0x7379b1d471b86dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86da7 expref: 12 pid: 5851 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770342.656119:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ab9d396c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725589888:0@lo:104: 00010000:00010000:0.0:1790770342.656135:0:5874:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656148:0:5874:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656153:0:5874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770342.656157:0:5874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b5903b3/0x7379b1d471b86ddf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770342.656183:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725590016:0@lo:103: 00000100:00100000:1.0:1790770342.668893:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f05ae9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5839:x1877758725589760:12345-0@lo:253: Request processed in 62093us (63021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770342.668910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790770342.669298:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010dc53ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5839:1877758725589760:0@lo:253: 10000000:01000000:2.0:1790770342.669313:0:5839:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790770342.669317:0:5839:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790770342.669319:0:5839:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790770342.669321:0:5839:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770342.669322:0:5839:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770342.669323:0:5839:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770342.669325:0:5839:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770342.669326:0:5839:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790770342.669328:0:5839:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790770342.669344:0:5839:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770342.669345:0:5839:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770342.669346:0:5839:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770342.669348:0:5839:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790770342.669364:0:5839:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1790770342.678130:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1790770342.678560:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.679354:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790770342.679784:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.680216:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1790770342.680580:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.681187:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790770342.682300:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.682777:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790770342.683264:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.683748:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1790770342.684145:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1790770342.684340:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1790770342.767967:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1790770342.849934:0:5839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1790770342.851514:0:5892:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1790770342.866188:0:5891:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790770342.866197:0:5891:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1790770342.869266:0:5839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790770342.871037:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790770342.871451:0:5839:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790770342.871824:0:5839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790770342.872237:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790770342.873774:0:5839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790770342.879314:0:5839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1790770342.879441:0:5839:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1790770342.880351:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1790770342.881002:0:5839:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1790770342.883835:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1790770342.884077:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1790770342.884221:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1790770342.884389:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1790770342.884531:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1790770342.884698:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1790770342.884860:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1790770342.885050:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1790770342.885205:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1790770342.885358:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1790770342.895128:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1790770342.895390:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1790770342.897408:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1790770342.897990:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1790770342.898138:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1790770342.898327:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1790770342.910615:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1790770342.913070:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1790770342.913355:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1790770342.920444:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1790770342.923834:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1790770342.924103:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1790770342.924245:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1790770342.924409:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1790770342.924549:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1790770342.924700:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1790770342.924868:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1790770342.925061:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1790770342.929902:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1790770342.930174:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1790770342.930311:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1790770342.930493:0:5839:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1790770342.930734:0:5839:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1790770343.010251:0:5892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1790770343.154357:0:5839:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790770343.154613:0:5839:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac7b41d9f988 00100000:10000000:1.0:1790770343.154622:0:5839:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790770343.156142:0:5839:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790770343.156160:0:5839:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790770343.156175:0:5839:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790770343.156208:0:5839:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1790770343.216126:0:5892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790770343.216224:0:5892:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1790770343.216232:0:5892:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1790770343.704119:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770344.733237:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770345.751234:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770346.774152:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770347.798131:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790770347.864401:0:477:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1790770347.864411:0:477:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790770347.864414:0:477:0:(import.c:65:import_set_state_nolock()) 00000000a6d3ec2d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790770347.864430:0:477:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a6d3ec2d using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1790770347.864452:0:477:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e3ea689c x1877758725590272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790770347.864536:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790770347.864549:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725590144:0@lo:400: 00000100:00100000:1.0:1790770347.864632:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770347.864687:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1877758725590272:0@lo:38: 00000100:00100000:1.0:1790770347.864731:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770347.864772:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590144 00000100:00100000:1.0:1790770347.864780:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590144 00000100:00100000:1.0:1790770347.864823:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790770347.864830:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a9dfd7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:3324:x1877758725590144:12345-0@lo:400: 00000100:00100000:1.0:1790770347.864878:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a9dfd7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:3324:x1877758725590144:12345-0@lo:400: Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770347.864885:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790770347.864930:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725590144:0@lo:400: 00000100:00100000:1.0:1790770347.865031:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590272 00000100:00100000:1.0:1790770347.865036:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590272 00000100:00100000:1.0:1790770347.865057:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790770347.865061:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000000c814479 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1877758725590272:12345-0@lo:38: 00010000:00080000:1.0:1790770347.865091:0:5860:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1790770347.865124:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7379b1d471b86de6 00000004:00100000:1.0:1790770347.865173:0:5860:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790770347.865308:0:5860:0:(import.c:65:import_set_state_nolock()) 00000000309dadd2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790770347.865349:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000000c814479 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1877758725590272:12345-0@lo:38: Request processed in 287us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770347.865356:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790770347.865387:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e3ea689c x1877758725590272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790770357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790770347.865400:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790770347.865407:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790770347.865411:0:3320:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790770347.865413:0:3320:0:(import.c:65:import_set_state_nolock()) 00000000a6d3ec2d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790770347.865418:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1877758725590272:0@lo:38: 00000001:02000400:0.0:1790770348.489660:0:6135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790770348.835858:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790770349.398077:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790770349.398086:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92c1c64e1000 from 3 10000000:01000000:0.0:1790770349.398091:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790770349.398142:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770349.398154:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770349.398165:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770349.398207:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725590400:0@lo:101: 00000100:00100000:0.0:1790770349.398301:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770349.398444:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c92c5ebc going to sleep for 11 seconds 00000100:00100000:1.0:1790770349.401428:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590400 00000100:00100000:1.0:1790770349.401443:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590400 00000100:00100000:1.0:1790770349.401523:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790770349.401532:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cf27fad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5855:x1877758725590400:12345-0@lo:101: 00010000:00010000:1.0:1790770349.401560:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770349.401581:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097414515/0x7379b1d471b86df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86ded expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770349.401608:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097414515/0x7379b1d471b86df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86ded expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770349.401618:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097414515/0x7379b1d471b86df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86ded expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770349.401646:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097414515, rc 0) 00000100:00100000:1.0:1790770349.401746:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cf27fad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725590400:12345-0@lo:101: Request processed in 215us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770349.401753:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790770349.402133:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725590400:0@lo:101: 00010000:00010000:0.0:1790770349.402158:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770349.402166:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770349.402226:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725590528:0@lo:256: 00000100:00100000:0.0:1790770349.402398:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770349.402440:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c92c5ebc going to sleep for 11 seconds 00000100:00100000:2.0:1790770349.402727:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590528 00000100:00100000:2.0:1790770349.402734:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590528 00000100:00100000:2.0:1790770349.402768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790770349.402774:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000069a759ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725590528:12345-0@lo:256: 20000000:01000000:2.0:1790770349.402791:0:5851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790770349.402807:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790770349.402810:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790770349.402886:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000069a759ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725590528:12345-0@lo:256: Request processed in 113us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770349.402893:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790770349.406212:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9b809fb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725590528:0@lo:256: 10000000:01000000:0.0:1790770349.406297:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790770349.406307:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770349.406319:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: 000000001477d2f9/0x7379b1d471b86ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770349.850583:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770350.872060:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770351.896179:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770352.918140:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790770352.982244:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790770352.982266:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725590656:0@lo:400: 00000100:00100000:0.0:1790770352.982325:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725590784:0@lo:400: 00000100:00100000:1.0:1790770352.982358:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770352.982386:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590656 00000100:00100000:2.0:1790770352.982395:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590656 00000100:00100000:2.0:1790770352.982452:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790770352.982460:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c117ce96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3323:x1877758725590656:12345-0@lo:400: 00000100:00100000:0.0:1790770352.982884:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770352.983042:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590784 00000100:00100000:0.0:1790770352.983048:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590784 00000100:00100000:0.0:1790770352.983084:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770352.983104:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c9b809fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725590784:12345-0@lo:400: 00000100:00100000:0.0:1790770352.983149:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c9b809fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725590784:12345-0@lo:400: Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770352.983155:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790770352.983193:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000009c38bc5 x1877758725590784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770352.983207:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009c38bc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725590784:0@lo:400: 00000100:00100000:2.0:1790770352.991856:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c117ce96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3323:x1877758725590656:12345-0@lo:400: Request processed in 9388us (9489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770352.991879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790770352.992908:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725590656:0@lo:400: 00010000:00010000:2.0:1790770353.951031:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790770354.080639:0:6338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffced8e5820 20000000:00000080:0.0:1790770354.080659:0:6338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92c1ef096400 uarg=0000000000000000 20000000:01000000:0.0:1790770354.080708:0:6338:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1790770354.080716:0:6338:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1790770354.080721:0:6338:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790770354.084018:0:6338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1790770354.084343:0:6338:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790770354.099092:0:6338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790770354.101159:0:6338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790770354.101263:0:6338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790770354.101324:0:6338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790770354.101346:0:6338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790770354.101381:0:6338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.101400:0:6338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.101408:0:6338:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.101450:0:6338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.101467:0:6338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770354.101499:0:6338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000649cf8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6338:1877758725590912:0@lo:104: 00000100:00100000:3.0:1790770354.101570:0:6338:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770354.101649:0:6338:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047abcc90 going to sleep for 11 seconds 00000100:00100000:0.0:1790770354.102303:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725590912 00000100:00100000:0.0:1790770354.102313:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725590912 00000100:00100000:0.0:1790770354.102358:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790770354.102367:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001bb7bb5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:6338:x1877758725590912:12345-0@lo:104: 00010000:00010000:0.0:1790770354.102393:0:5842:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770354.102456:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790770354.102460:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001bb7bb5c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:6338:x1877758725590912:12345-0@lo:104: Request processed in 96us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770354.102468:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1790770354.102620:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790770354.102626:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002fa4caea already unused, calling callback (000000006903dfb8) 10000000:00010000:1.0:1790770354.102637:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102646:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790770354.102654:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770354.102660:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790770354.102697:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102704:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790770354.102733:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102739:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: 000000002fa4caea/0x7379b1d471b86db5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dbc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102770:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770354.102772:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770354.102774:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790770354.102787:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725591040:0@lo:103: 00000100:00100000:1.0:1790770354.102824:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770354.102869:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591040 00000100:00100000:1.0:1790770354.102873:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591040 00010000:00010000:1.0:1790770354.102891:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 12 pid: 5852 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770354.102913:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790770354.102920:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e877afac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3322:x1877758725591040:12345-0@lo:103: 00010000:00010000:1.0:1790770354.102930:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790770354.102934:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 12 pid: 5852 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102970:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 12 pid: 5852 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102986:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.102994:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103020:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103040:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103046:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103052:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103058:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a95639be already unused, calling callback (00000000f8758765) 00010000:00010000:1.0:1790770354.103061:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103068:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103076:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770354.103097:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790770354.103126:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e877afac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3322:x1877758725591040:12345-0@lo:103: Request processed in 207us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770354.103133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790770354.103171:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3ea689c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725591040:0@lo:103: 00010000:00010000:3.0:1790770354.103737:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c76de60/0x7379b1d471b86dbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86db5 expref: 11 pid: 5852 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770354.103761:0:6338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000649cf8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6338:1877758725590912:0@lo:104: 00010000:00010000:3.0:1790770354.103774:0:6338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.103782:0:6338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.103787:0:6338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770354.103791:0:6338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a95639be/0x7379b1d471b86dfb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770354.966107:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790770355.734075:0:5855:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790770355.734085:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92c1c64e1000 from 1 10000000:01000000:0.0:1790770355.734090:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790770355.734158:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: 00000000d27213b2/0x7379b1d471b86e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770355.734171:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: 00000000d27213b2/0x7379b1d471b86e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770355.734180:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: 00000000d27213b2/0x7379b1d471b86e02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770355.734203:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591168:0@lo:101: 00000100:00100000:0.0:1790770355.734296:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770355.734382:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591168 00000100:00100000:3.0:1790770355.734390:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591168 00000100:00100000:0.0:1790770355.734488:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3a0de70 going to sleep for 11 seconds 00000100:00100000:3.0:1790770355.734508:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790770355.734519:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000290120fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:5855:x1877758725591168:12345-0@lo:101: 00010000:00010000:3.0:1790770355.734531:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770355.734546:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024932d2f/0x7379b1d471b86e09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e02 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770355.734583:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024932d2f/0x7379b1d471b86e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e02 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770355.734601:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024932d2f/0x7379b1d471b86e09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e02 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770355.734609:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024932d2f, rc 0) 00000100:00100000:3.0:1790770355.734661:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000290120fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725591168:12345-0@lo:101: Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770355.734667:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790770355.734742:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591168:0@lo:101: 00010000:00010000:0.0:1790770355.734757:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: 00000000d27213b2/0x7379b1d471b86e02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e09 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770355.734764:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: 00000000d27213b2/0x7379b1d471b86e02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86e09 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770355.734811:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591296:0@lo:501: 00000100:00100000:0.0:1790770355.734835:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770355.743795:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3a0de70 going to sleep for 11 seconds 00000100:00100000:2.0:1790770355.743959:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591296 00000100:00100000:2.0:1790770355.743971:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591296 00000100:00100000:2.0:1790770355.744019:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790770355.744027:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e02390e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725591296:12345-0@lo:501: 00000100:00100000:2.0:1790770355.744313:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e02390e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725591296:12345-0@lo:501: Request processed in 287us (9477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770355.744321:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790770355.744537:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591296:0@lo:501: 00000100:00100000:0.0:1790770355.744596:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591424:0@lo:503: 00000100:00100000:0.0:1790770355.744639:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770355.744668:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3a0de70 going to sleep for 11 seconds 00000100:00100000:2.0:1790770355.744719:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591424 00000100:00100000:2.0:1790770355.744723:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591424 00000100:00100000:2.0:1790770355.744742:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790770355.744747:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000010e53d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725591424:12345-0@lo:503: 00000100:00100000:2.0:1790770355.744869:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000010e53d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725591424:12345-0@lo:503: Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770355.744876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790770355.744974:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725591424:0@lo:503: 00000100:00100000:0.0:1790770355.746355:0:6398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6398:1877758725591552:0@lo:502: 00000100:00100000:0.0:1790770355.746432:0:6398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770355.746462:0:6398:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b2e4db89 going to sleep for 11 seconds 00000100:00100000:2.0:1790770355.746626:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591552 00000100:00100000:2.0:1790770355.746634:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591552 00000100:00100000:2.0:1790770355.746675:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790770355.746682:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005bf7d93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6398:x1877758725591552:12345-0@lo:502: 00000100:00100000:2.0:1790770355.746868:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005bf7d93f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6398:x1877758725591552:12345-0@lo:502: Request processed in 186us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770355.746875:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790770355.746968:0:6398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c909b8d pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6398:1877758725591552:0@lo:502: 00000020:01000000:0.0:1790770355.746994:0:6398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790770355.747003:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770355.747005:0:6398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790770355.747012:0:6398:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92c1c64e1000 00000020:00000080:0.0:1790770355.747014:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790770355.747064:0:6398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6398:1877758725591680:0@lo:502: 00000100:00100000:0.0:1790770355.747108:0:6398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770355.747132:0:6398:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c389bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770355.747244:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591680 00000100:00100000:2.0:1790770355.747249:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591680 00000100:00100000:2.0:1790770355.747268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790770355.747281:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6398:x1877758725591680:12345-0@lo:502: 00000100:00100000:2.0:1790770355.747402:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6398:x1877758725591680:12345-0@lo:502: Request processed in 121us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770355.747408:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790770355.747763:0:6398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6398:1877758725591680:0@lo:502: 00000020:01000000:0.0:1790770355.747784:0:6398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790770355.747789:0:6398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770355.747791:0:6398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790770355.747795:0:6398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790770355.747969:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790770355.747987:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790770355.747997:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c0030c00/0x7379b1d471b86e02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e09 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770355.748008:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c0030c00/0x7379b1d471b86e02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e09 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770355.997871:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770357.020039:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770358.042170:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770358.102549:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725591936:0@lo:400: 00000100:00100000:0.0:1790770358.102617:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770358.102672:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790770358.102678:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725591808:0@lo:400: 00000100:00100000:0.0:1790770358.102708:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770358.102744:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591936 00000100:00100000:0.0:1790770358.102753:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591936 00000100:00100000:0.0:1790770358.102800:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790770358.102808:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725591936:12345-0@lo:400: 00000100:00100000:0.0:1790770358.102865:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725591936:12345-0@lo:400: Request processed in 58us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770358.102882:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790770358.102907:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725591808 00000100:00100000:0.0:1790770358.102911:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725591808 00000100:00100000:0.0:1790770358.102932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790770358.102937:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3324:x1877758725591808:12345-0@lo:400: 00000100:00100000:0.0:1790770358.103183:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3324:x1877758725591808:12345-0@lo:400: Request processed in 245us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770358.103190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790770358.103232:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725591808:0@lo:400: 00010000:00080000:0.0:1790770358.103245:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92c1fb380380 x1877758725591936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770358.103257:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725591936:0@lo:400: 00010000:00010000:0.0:1790770359.065078:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770360.088206:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790770360.834363:0:6710:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790770360.834368:0:6710:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790770360.834527:0:6710:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92c1c9563800 00000020:01000004:1.0:1790770360.834547:0:6710:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1790770360.834560:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790770360.834575:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92c1c84f4d40) 00000020:00000080:1.0:1790770360.834591:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790770360.856166:0:6710:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1790770360.856403:0:6710:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790770360.908435:0:6710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790770360.916701:0:6710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790770360.916734:0:6710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790770360.916789:0:6710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790770360.916814:0:6710:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790770360.917222:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790770360.917236:0:6710:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790770360.917251:0:6710:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7379b1d471b86e17 00000020:01000004:2.0:1790770360.917261:0:6710:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790770360.917285:0:6710:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790770360.917289:0:6710:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790770360.917296:0:6710:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790770360.917301:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790770360.917315:0:6710:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92c1f63e19c0) 00000020:00000080:2.0:1790770360.917325:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790770360.922037:0:6710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790770360.922362:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790770360.923019:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790770360.929239:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790770360.929258:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1790770360.930061:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1790770360.930070:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790770360.935214:0:6710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790770360.935756:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790770360.935763:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790770360.936640:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790770360.936648:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790770361.081139:0:6710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790770361.082892:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790770361.082899:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790770361.098445:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790770361.098471:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790770361.103475:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790770361.103492:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00010000:00010000:0.0:1790770361.110162:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790770361.130135:0:6710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790770361.130630:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790770361.130636:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790770361.131837:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790770361.131848:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790770362.061053:0:6710:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790770362.061446:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790770362.061454:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790770362.066812:0:6710:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790770362.066828:0:6710:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790770362.069470:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790770362.069502:0:6710:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790770362.069511:0:6710:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790770362.118617:0:6710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790770362.118666:0:6710:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.126@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790770362.118671:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790770362.118673:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790770362.118675:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770362.118676:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770362.118678:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770362.118679:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770362.118681:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790770362.118683:0:6710:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770362.118685:0:6710:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770362.118687:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770362.118689:0:6710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790770362.118694:0:6710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790770362.118696:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790770362.118698:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790770362.118699:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770362.118701:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770362.118702:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770362.118703:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770362.118704:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790770362.118706:0:6710:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770362.118707:0:6710:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770362.118708:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770362.118709:0:6710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790770362.118750:0:6710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790770362.118774:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725592064:0@lo:253: 00000100:00100000:2.0:1790770362.118873:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.119011:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d003b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.121795:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592064 00000100:00100000:1.0:1790770362.121818:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592064 00000100:00100000:1.0:1790770362.121910:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790770362.121922:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725592064:12345-0@lo:253: 20000000:01000000:1.0:1790770362.122060:0:5851:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790770362.122066:0:5851:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1790770362.122083:0:5851:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1790770362.122086:0:5851:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1790770362.123303:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790770362.123560:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1790770362.123575:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1790770362.123616:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1790770362.123624:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1790770362.123654:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1790770362.123703:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1790770362.124130:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1790770362.124154:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:1.0:1790770362.124162:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:1.0:1790770362.124204:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1790770362.124213:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790770362.124265:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1790770362.124274:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:1.0:1790770362.124305:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1790770362.124316:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790770362.124348:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1790770362.124394:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1790770362.130100:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1790770362.130137:0:5851:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:2.0:1790770362.130140:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:2.0:1790770362.130481:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1790770362.130492:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1790770362.130530:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1790770362.130549:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:2.0:1790770362.130603:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1790770362.130614:0:5851:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1790770362.130650:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1790770362.130689:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1790770362.130709:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790770362.130713:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790770362.130717:0:5851:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790770362.130733:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790770362.130736:0:5851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790770362.130774:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790770362.130776:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00010000:00010000:2.0:1790770362.135205:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1790770362.135752:0:6725:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1790770362.135834:0:6725:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1790770362.135874:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1790770362.136672:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1790770362.136718:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1790770362.136748:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1790770362.136760:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790770362.136762:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790770362.137929:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790770362.139189:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790770362.139242:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790770362.139320:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790770362.139335:0:5851:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790770362.139349:0:5851:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790770362.140691:0:6727:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1790770362.140792:0:6727:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1790770362.140846:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790770362.141582:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790770362.141628:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790770362.141697:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790770362.141720:0:5851:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790770362.141722:0:5851:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790770362.141733:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790770362.141756:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141776:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141784:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141791:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141799:0:5851:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141841:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.141856:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 12 pid: 5853 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.141874:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592192:0@lo:104: 00000100:00100000:0.0:1790770362.142284:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790770362.142358:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.142476:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.142489:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592320:0@lo:104: 00000100:00100000:0.0:1790770362.142518:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790770362.142541:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.142550:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 12 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.142559:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592448:0@lo:104: 00000100:00100000:0.0:1790770362.142578:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.142588:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca404600 going to sleep for 11 seconds 00000100:00100000:2.0:1790770362.144298:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592192 00000100:00100000:2.0:1790770362.144317:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592192 00000100:00100000:2.0:1790770362.144380:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592320 00000100:00100000:2.0:1790770362.144383:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592320 00000100:00100000:2.0:1790770362.144550:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592448 00000100:00100000:2.0:1790770362.144555:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592448 00000100:00100000:2.0:1790770362.144577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770362.144587:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5851:x1877758725592192:12345-0@lo:104: 00010000:00010000:2.0:1790770362.144605:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.144732:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790770362.144738:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5851:x1877758725592192:12345-0@lo:104: Request processed in 153us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.144745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770362.144764:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790770362.144771:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+4:5851:x1877758725592320:12345-0@lo:104: 00010000:00010000:2.0:1790770362.144779:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.144818:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790770362.144823:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+4:5851:x1877758725592320:12345-0@lo:104: Request processed in 54us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.144829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790770362.144841:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790770362.144847:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5851:x1877758725592448:12345-0@lo:104: 00010000:00010000:2.0:1790770362.144854:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.144885:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790770362.144890:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5851:x1877758725592448:12345-0@lo:104: Request processed in 44us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.144895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790770362.144914:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790770362.144921:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.144928:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c29b7400 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1790770362.144970:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.144980:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790770362.144988:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.144995:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790770362.145038:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145045:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790770362.145068:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145082:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7400/0x7379b1d471b86dc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86dca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145100:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790770362.145103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145109:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1401e00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1790770362.145112:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145118:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790770362.145135:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.145140:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790770362.145154:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145159:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790770362.145165:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145171:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86d53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145181:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790770362.145184:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145190:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1400600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1790770362.145192:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145199:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790770362.145204:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.145210:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790770362.145229:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145235:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790770362.145251:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145258:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1400600/0x7379b1d471b86d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86d3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.145275:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770362.145277:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770362.145279:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790770362.145306:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725592576:0@lo:103: 00000100:00100000:2.0:1790770362.146049:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790770362.146292:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770362.146304:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790770362.146321:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725592832:0@lo:103: 00000100:00100000:0.0:1790770362.146408:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592192:0@lo:104: 00000100:00100000:0.0:1790770362.146421:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592320:0@lo:104: 00000100:00100000:0.0:1790770362.146430:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5851:1877758725592448:0@lo:104: 00010000:00010000:0.0:1790770362.146469:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.146637:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790770362.146644:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725592704:0@lo:103: 00000100:00100000:2.0:1790770362.146667:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.149084:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.149185:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592576 00000100:00100000:3.0:1790770362.149197:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592576 00010000:00010000:3.0:1790770362.149240:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 13 pid: 5853 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.149483:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592704 00000100:00100000:2.0:1790770362.149488:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592704 00010000:00010000:2.0:1790770362.149507:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 14 pid: 5851 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.149540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770362.149548:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:3321:x1877758725592576:12345-0@lo:103: 00010000:00010000:2.0:1790770362.149562:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790770362.149568:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 14 pid: 5853 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149581:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 14 pid: 5853 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149616:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c29b6a00/0x7379b1d471b86dca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86dc3 expref: 14 pid: 5853 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149633:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790770362.149706:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3321:x1877758725592576:12345-0@lo:103: Request processed in 159us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.149714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770362.149733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790770362.149739:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3321:x1877758725592704:12345-0@lo:103: 00010000:00010000:2.0:1790770362.149748:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790770362.149752:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149761:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149771:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c29b6600/0x7379b1d471b86d5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86d53 expref: 12 pid: 5851 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.149780:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790770362.149804:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:3321:x1877758725592704:12345-0@lo:103: Request processed in 65us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.149810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790770362.149851:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725592704:0@lo:103: 00000100:00100000:2.0:1790770362.149860:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725592576:0@lo:103: 00000100:00100000:2.0:1790770362.150515:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592832 00000100:00100000:2.0:1790770362.150523:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592832 00010000:00010000:2.0:1790770362.150554:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 11 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.150588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790770362.150596:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb383800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:3324:x1877758725592832:12345-0@lo:103: 00010000:00010000:2.0:1790770362.150605:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790770362.150610:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 11 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150619:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 11 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150631:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c0030a00/0x7379b1d471b86d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86d37 expref: 11 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150646:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150655:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150672:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150680:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150688:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150695:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150712:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c2007ef600 already unused, calling callback (ffffffffc14cbac0) 00010000:00010000:2.0:1790770362.150718:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150727:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150751:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.150763:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790770362.150801:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb383800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:3324:x1877758725592832:12345-0@lo:103: Request processed in 206us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.150808:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790770362.150850:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725592832:0@lo:103: 00010000:00010000:0.0:1790770362.151116:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.151138:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.151146:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790770362.151163:0:5851:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790770362.236403:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:6710:x1877758725592064:12345-0@lo:253: Request processed in 114464us (117510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.236420:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790770362.236518:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725592064:0@lo:253: 10000000:01000000:3.0:1790770362.236536:0:6710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1790770362.236539:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790770362.236554:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790770362.236555:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790770362.236556:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1790770362.236557:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790770362.236559:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790770362.236561:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790770362.236563:0:6710:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790770362.236565:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790770362.236566:0:6710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790770362.236589:0:6710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92c1c9563800 from lustre-OST0000 10000000:01000000:3.0:1790770362.236616:0:6710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1790770362.236619:0:6710:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790770362.236626:0:6710:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92c1e2b94d40 local copy 10000000:01000000:3.0:1790770362.236630:0:6710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790770362.236664:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.236675:0:6710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.236685:0:6710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770362.236704:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725592960:0@lo:101: 00000100:00100000:3.0:1790770362.236741:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.236788:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725592960 00000100:00100000:0.0:1790770362.236796:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725592960 00000100:00100000:0.0:1790770362.236840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790770362.236847:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c200949840 going to sleep for 11 seconds 00000100:00100000:0.0:1790770362.236851:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+9:6710:x1877758725592960:12345-0@lo:101: 00010000:00010000:0.0:1790770362.236865:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770362.236878:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e2c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.236900:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e2c expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.236910:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e2c expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.236920:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c2007ef600, rc 0) 00000100:00100000:0.0:1790770362.236976:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:6710:x1877758725592960:12345-0@lo:101: Request processed in 127us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.236982:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790770362.241404:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725592960:0@lo:101: 00010000:00010000:3.0:1790770362.241452:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.241465:0:6710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770362.241642:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593088:0@lo:501: 00000100:00100000:3.0:1790770362.241710:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.241834:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593088 00000100:00100000:0.0:1790770362.241844:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593088 00000100:00100000:0.0:1790770362.241897:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790770362.241907:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:6710:x1877758725593088:12345-0@lo:501: 00000100:00100000:0.0:1790770362.242229:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:6710:x1877758725593088:12345-0@lo:501: Request processed in 322us (519us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790770362.242238:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790770362.245916:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c200949840 going to sleep for 11 seconds 00000100:00100000:3.0:1790770362.245985:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593088:0@lo:501: 10000000:01000000:3.0:1790770362.246010:0:6710:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790770362.246093:0:6710:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790770362.246103:0:6710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.246114:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.246123:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.246158:0:6710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790770362.246183:0:6710:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92c1c9563800 10000000:01000000:3.0:1790770362.246189:0:6710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790770362.246194:0:6710:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92c1e2b94d40 10000000:01000000:3.0:1790770362.246197:0:6710:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790770362.246200:0:6710:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92c1e2b94d40 from 1 10000000:01000000:3.0:1790770362.246203:0:6710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790770362.246247:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.246257:0:6710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246269:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790770362.246277:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246293:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1401400 already unused, calling callback (ffffffffc1b18c20) 00010000:00010000:3.0:1790770362.246297:0:6710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790770362.246298:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246318:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790770362.246326:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770362.246329:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593216:0@lo:101: 10000000:01000000:0.0:1790770362.246339:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790770362.246364:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246372:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790770362.246403:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.246431:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c200949300 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.246516:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593216 00000100:00100000:1.0:1790770362.246523:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593216 00000100:00100000:1.0:1790770362.246576:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790770362.246585:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:6710:x1877758725593216:12345-0@lo:101: 00010000:00010000:1.0:1790770362.246598:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770362.246610:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1651400/0x7379b1d471b86e41 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e3a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.246632:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1651400/0x7379b1d471b86e41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e3a expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.246641:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1651400/0x7379b1d471b86e41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e3a expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.246649:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1651400, rc 0) 00000100:00100000:1.0:1790770362.246687:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593216:12345-0@lo:101: Request processed in 102us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.246693:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790770362.246737:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725593344:0@lo:103: 00000100:00100000:1.0:1790770362.246764:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790770362.246810:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246818:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1401400/0x7379b1d471b86e2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86e33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.246840:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770362.246842:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770362.246844:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770362.247009:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593344 00000100:00100000:0.0:1790770362.247014:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593344 00000100:00100000:0.0:1790770362.247048:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790770362.247055:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:3324:x1877758725593344:12345-0@lo:103: 00010000:00010000:0.0:1790770362.247065:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790770362.247077:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7379b1d471b86e2c expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.247092:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770362.248642:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593216:0@lo:101: 00010000:00010000:3.0:1790770362.248681:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e41 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.248695:0:6710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86e41 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770362.248721:0:6710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790770362.248740:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e41 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.248747:0:6710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1400c00/0x7379b1d471b86e3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e41 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770362.248757:0:6710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790770362.248766:0:6710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790770362.248774:0:6710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790770362.248778:0:6710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790770362.248812:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.248820:0:6710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.248848:0:6710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770362.248868:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593472:0@lo:101: 00000100:00100000:3.0:1790770362.248924:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.248981:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c200949300 going to sleep for 11 seconds 00000100:00100000:0.0:1790770362.251365:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:3324:x1877758725593344:12345-0@lo:103: Request processed in 4296us (4585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.251384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790770362.251584:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593472 00000100:00100000:3.0:1790770362.251595:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593472 00000100:00100000:3.0:1790770362.251715:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790770362.251725:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+10:6710:x1877758725593472:12345-0@lo:101: 00010000:00010000:3.0:1790770362.251747:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770362.251774:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e48 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.251807:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.251819:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.251829:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1400600, rc 0) 00000100:00100000:3.0:1790770362.251913:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593472:12345-0@lo:101: Request processed in 191us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770362.251919:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790770362.252310:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725593344:0@lo:103: 00000100:00100000:2.0:1790770362.253241:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593472:0@lo:101: 00010000:00010000:2.0:1790770362.253263:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.253272:0:6710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.253390:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593600:0@lo:501: 00000100:00100000:2.0:1790770362.253449:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.256703:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf0d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770362.259357:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593600 00000100:00100000:0.0:1790770362.259375:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593600 00000100:00100000:0.0:1790770362.259518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790770362.259530:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593600:12345-0@lo:501: 00000100:00100000:0.0:1790770362.259897:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593600:12345-0@lo:501: Request processed in 369us (6462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.259905:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790770362.260039:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593600:0@lo:501: 00000100:00100000:2.0:1790770362.260112:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593728:0@lo:503: 00000100:00100000:2.0:1790770362.260170:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.260207:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf0d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770362.260522:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593728 00000100:00100000:0.0:1790770362.260527:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593728 00000100:00100000:0.0:1790770362.260553:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790770362.260559:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593728:12345-0@lo:503: 00000100:00100000:0.0:1790770362.260752:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593728:12345-0@lo:503: Request processed in 192us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.260764:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790770362.261204:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593728:0@lo:503: 00000040:00080000:2.0:1790770362.261557:0:6710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790770362.261649:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593856:0@lo:502: 00000100:00100000:2.0:1790770362.261696:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.261730:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf0d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770362.262191:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593856 00000100:00100000:0.0:1790770362.262198:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593856 00000100:00100000:0.0:1790770362.262240:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790770362.262249:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593856:12345-0@lo:502: 00000100:00100000:0.0:1790770362.262428:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593856:12345-0@lo:502: Request processed in 180us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.262576:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790770362.265237:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593856:0@lo:502: 00000040:00080000:2.0:1790770362.265806:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1790770362.265879:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1790770362.265911:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790770362.266240:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790770362.266302:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790770362.266336:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790770362.266387:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593984:0@lo:502: 00000100:00100000:0.0:1790770362.266620:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.266683:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d08833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770362.266751:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725593984 00000100:00100000:3.0:1790770362.266759:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725593984 00000100:00100000:3.0:1790770362.266818:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790770362.266827:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593984:12345-0@lo:502: 00000100:00100000:3.0:1790770362.267315:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725593984:12345-0@lo:502: Request processed in 487us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770362.267324:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790770362.267495:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb380380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725593984:0@lo:502: 00000040:00080000:2.0:1790770362.267638:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1790770362.267653:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1790770362.274718:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790770362.274731:0:6728:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790770362.274739:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770362.274741:0:6728:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790770362.274748:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790770362.274764:0:6728:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92c1c84f0000) 00000020:00000080:1.0:1790770362.274787:0:6728:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790770362.274794:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790770362.274860:0:6728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92c1c9563800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790770362.274869:0:6728:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790770362.274875:0:6728:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7379b1d471b86e5d 00010000:00010000:0.0:1790770362.300124:0:6728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1790770362.301250:0:6728:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790770362.309177:0:6728:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790770362.309644:0:6728:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1790770362.324845:0:6728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790770362.325462:0:6728:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1790770362.329174:0:6728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1790770362.329190:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790770362.329197:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770362.329199:0:6728:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1790770362.329202:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790770362.329206:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770362.329207:0:6728:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790770362.329210:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790770362.329222:0:6728:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790770362.329294:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790770362.329297:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770362.329299:0:6728:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790770362.329302:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790770362.329610:0:6710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790770362.329637:0:6710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790770362.329664:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.329677:0:6710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.329686:0:6710:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92c1c9563800 from 1 10000000:01000000:2.0:1790770362.329688:0:6710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790770362.329730:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.329749:0:6710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.329761:0:6710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.329788:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594112:0@lo:101: 00000100:00100000:2.0:1790770362.329858:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.329895:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf0d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.332350:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594112 00000100:00100000:1.0:1790770362.332372:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594112 00000100:00100000:1.0:1790770362.332460:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790770362.332472:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:6710:x1877758725594112:12345-0@lo:101: 00010000:00010000:1.0:1790770362.332497:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770362.332524:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1650400/0x7379b1d471b86e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e64 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.332570:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1650400/0x7379b1d471b86e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e64 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.332582:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1650400/0x7379b1d471b86e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e64 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.332592:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1650400, rc 0) 00000100:00100000:1.0:1790770362.332682:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594112:12345-0@lo:101: Request processed in 213us (2823us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.332698:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790770362.332884:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594112:0@lo:101: 00010000:00010000:2.0:1790770362.332908:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e6b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.332919:0:6710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86e6b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.333080:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594240:0@lo:501: 00000100:00100000:2.0:1790770362.333121:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.333162:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf0d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.333306:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594240 00000100:00100000:1.0:1790770362.333311:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594240 00000100:00100000:1.0:1790770362.333346:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790770362.333353:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594240:12345-0@lo:501: 00000100:00100000:2.0:1790770362.339494:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594240:12345-0@lo:501: Request processed in 6125us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.339511:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790770362.344287:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594240:0@lo:501: 00000100:00100000:3.0:1790770362.344366:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594368:0@lo:503: 00000100:00100000:3.0:1790770362.344485:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.344534:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d003b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.344739:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594368 00000100:00100000:1.0:1790770362.344748:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594368 00000100:00100000:1.0:1790770362.344803:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790770362.344813:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594368:12345-0@lo:503: 00000100:00100000:1.0:1790770362.345780:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594368:12345-0@lo:503: Request processed in 964us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.345791:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790770362.347025:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594368:0@lo:503: 00000040:00080000:3.0:1790770362.347583:0:6710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790770362.347703:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594496:0@lo:502: 00000100:00100000:3.0:1790770362.347775:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.347826:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d003b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.351493:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594496 00000100:00100000:1.0:1790770362.351512:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594496 00000100:00100000:1.0:1790770362.351584:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790770362.351594:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594496:12345-0@lo:502: 00000100:00100000:1.0:1790770362.351985:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594496:12345-0@lo:502: Request processed in 392us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.351993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790770362.353456:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594496:0@lo:502: 00000040:00080000:3.0:1790770362.353890:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790770362.354015:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790770362.354085:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594624:0@lo:502: 00000100:00100000:3.0:1790770362.354580:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770362.354631:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d003b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770362.354661:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594624 00000100:00100000:3.0:1790770362.354669:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594624 00000100:00100000:3.0:1790770362.354712:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790770362.354720:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594624:12345-0@lo:502: 00000100:00100000:3.0:1790770362.354930:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594624:12345-0@lo:502: Request processed in 210us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770362.354968:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790770362.355022:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594624:0@lo:502: 00000040:00080000:3.0:1790770362.355139:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790770362.355151:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790770362.360808:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790770362.360838:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770362.360841:0:6732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790770362.360850:0:6732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92c1c9563800 00000020:00000080:0.0:1790770362.360854:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790770362.360881:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790770362.360885:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790770362.360887:0:6732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790770362.360890:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790770362.361032:0:6710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790770362.361071:0:6710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790770362.361095:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e6b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.361124:0:6710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6600/0x7379b1d471b86e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e6b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.361197:0:6710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790770362.361201:0:6710:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92c1c9563800 10000000:01000000:2.0:1790770362.361206:0:6710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92c1c9563800 10000000:01000000:2.0:1790770362.361221:0:6710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790770362.361228:0:6710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1c9563800 from 1 10000000:01000000:2.0:1790770362.361230:0:6710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790770362.361286:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.361294:0:6710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.361308:0:6710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770362.361336:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594752:0@lo:101: 00000100:00100000:2.0:1790770362.361452:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.361505:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c200949000 going to sleep for 11 seconds 00000100:00100000:3.0:1790770362.362150:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594752 00000100:00100000:3.0:1790770362.362162:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594752 00000100:00100000:3.0:1790770362.362235:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790770362.362250:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725594752:12345-0@lo:101: 00010000:00010000:3.0:1790770362.362272:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770362.362294:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.362326:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.362337:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770362.362347:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1401e00, rc 0) 00000100:00100000:3.0:1790770362.362440:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725594752:12345-0@lo:101: Request processed in 184us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770362.362447:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790770362.363069:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594752:0@lo:101: 00010000:00010000:0.0:1790770362.363093:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.363104:0:6710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.363244:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594880:0@lo:501: 00000100:00100000:0.0:1790770362.363285:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.363310:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d0883f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.363382:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725594880 00000100:00100000:1.0:1790770362.363388:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725594880 00000100:00100000:1.0:1790770362.363456:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790770362.363466:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725594880:12345-0@lo:501: 00000100:00100000:1.0:1790770362.363779:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725594880:12345-0@lo:501: Request processed in 314us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.363787:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790770362.364190:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725594880:0@lo:501: 00000100:00100000:0.0:1790770362.364230:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595008:0@lo:503: 00000100:00100000:0.0:1790770362.364279:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.364315:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d0883f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790770362.364355:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595008 00000100:00100000:2.0:1790770362.364363:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595008 00000100:00100000:2.0:1790770362.364415:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790770362.364423:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595008:12345-0@lo:503: 00000100:00100000:2.0:1790770362.364602:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595008:12345-0@lo:503: Request processed in 179us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.364608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790770362.366836:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595008:0@lo:503: 00000040:00080000:1.0:1790770362.367269:0:6710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790770362.367382:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595136:0@lo:502: 00000100:00100000:1.0:1790770362.367709:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770362.367808:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d00c86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770362.372772:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595136 00000100:00100000:2.0:1790770362.372792:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595136 00000100:00100000:2.0:1790770362.372934:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790770362.372972:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595136:12345-0@lo:502: 00000100:00100000:2.0:1790770362.373563:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595136:12345-0@lo:502: Request processed in 594us (5854us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.373573:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790770362.373656:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595136:0@lo:502: 00000040:00080000:0.0:1790770362.379239:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1790770362.379365:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1790770362.379403:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1790770362.379464:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1790770362.379518:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1790770362.379569:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1790770362.379615:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1790770362.379649:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1790770362.379715:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1790770362.379749:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1790770362.379776:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1790770362.379815:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1790770362.379845:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1790770362.379872:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1790770362.379916:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1790770362.379983:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1790770362.380018:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1790770362.380067:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1790770362.380107:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1790770362.380143:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1790770362.380224:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1790770362.380265:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1790770362.380299:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1790770362.380348:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1790770362.380385:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1790770362.380424:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1790770362.380490:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1790770362.380530:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1790770362.380591:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595264:0@lo:502: 00000100:00100000:0.0:1790770362.380671:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.382517:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d0883900 going to sleep for 11 seconds 00000100:00100000:1.0:1790770362.382631:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595264 00000100:00100000:1.0:1790770362.382654:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595264 00000100:00100000:1.0:1790770362.382839:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790770362.382852:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595264:12345-0@lo:502: 00000100:00100000:1.0:1790770362.383387:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595264:12345-0@lo:502: Request processed in 536us (2714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.383396:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790770362.384053:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595264:0@lo:502: 00000040:00080000:0.0:1790770362.384230:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1790770362.384263:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1790770362.387354:0:6733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790770362.387376:0:6733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92c1c804b380) 00000020:00000080:0.0:1790770362.387402:0:6733:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1790770362.387549:0:6733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92c1c9563800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790770362.387554:0:6733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92c1c9563800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790770362.387557:0:6733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92c1c9563800 3 00010000:00080000:0.0:1790770362.387596:0:6733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92c1ffe35000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.126@tcp at head 00010000:00010000:0.0:1790770362.393382:0:6733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1790770362.394328:0:6733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790770362.394380:0:6733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790770362.394396:0:6733:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7379b1d471b86e87 00000100:00080000:0.0:1790770362.394410:0:6733:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790770362.394424:0:6733:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92c1ffe35000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:0.0:1790770362.394481:0:6733:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92c1fb383480 x1877758725595392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790770362.394513:0:6733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790770362.394654:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1877758725595392:0@lo:38: 00000100:00100000:1.0:1790770362.394748:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.395344:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595392 00000100:00100000:0.0:1790770362.395356:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595392 00000100:00100000:0.0:1790770362.395391:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790770362.395399:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1877758725595392:12345-0@lo:38: 00010000:00080000:0.0:1790770362.395440:0:5860:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1790770362.395502:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7379b1d471b86e8e 00000004:00100000:0.0:1790770362.395520:0:5860:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790770362.395563:0:5860:0:(import.c:65:import_set_state_nolock()) ffff92c1ffe36800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790770362.395633:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1877758725595392:12345-0@lo:38: Request processed in 233us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.395641:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1790770362.395825:0:6733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:1.0:1790770362.396478:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92c1fb383480 x1877758725595392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790770372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770362.396493:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790770362.396503:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1790770362.396510:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790770362.396514:0:3320:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790770362.396517:0:3320:0:(import.c:65:import_set_state_nolock()) ffff92c1ffe35000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790770362.396523:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1877758725595392:0@lo:38: 00000020:01000000:1.0:1790770362.396560:0:6710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1790770362.396586:0:6710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790770362.396603:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770362.396630:0:6710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790770362.396708:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790770362.396711:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790770362.396713:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790770362.396714:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790770362.396716:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790770362.396717:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790770362.396719:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790770362.396721:0:6710:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790770362.396722:0:6710:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790770362.396724:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790770362.396726:0:6710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790770362.396731:0:6710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1790770362.396734:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790770362.396736:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790770362.396737:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790770362.396739:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790770362.396740:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790770362.396741:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790770362.396742:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790770362.396743:0:6710:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790770362.396744:0:6710:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790770362.396746:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790770362.396747:0:6710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790770362.396778:0:6710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790770362.396798:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595520:0@lo:253: 00000100:00100000:1.0:1790770362.396859:0:6710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770362.396890:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595520 00000100:00100000:1.0:1790770362.396897:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595520 00000100:00100000:1.0:1790770362.396937:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790770362.396973:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6710:x1877758725595520:12345-0@lo:253: 20000000:01000000:1.0:1790770362.397011:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1790770362.397302:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725595648:0@lo:400: 00000100:00100000:2.0:1790770362.397340:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1790770362.397590:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1790770362.398149:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595648 00000100:00100000:0.0:1790770362.398158:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595648 00000100:00100000:0.0:1790770362.398201:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790770362.398217:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725595648:12345-0@lo:400: 00000100:00100000:0.0:1790770362.398279:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725595648:12345-0@lo:400: Request processed in 63us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.398285:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790770362.398330:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92c1f638d500 x1877758725595648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770362.398344:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725595648:0@lo:400: 00000100:00100000:1.0:1790770362.398537:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d00c86c0 going to sleep for 11 seconds 20000000:01000000:2.0:1790770362.450344:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790770362.450366:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790770362.450483:0:5874:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790770362.450490:0:5874:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790770362.450516:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.450538:0:5874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86ded expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.450548:0:5874:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.450598:0:5874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.450614:0:5874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 13 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.450630:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725595776:0@lo:104: 00000100:00100000:0.0:1790770362.450704:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770362.450772:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d0883f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790770362.450823:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595776 00000100:00100000:2.0:1790770362.450832:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595776 00000100:00100000:2.0:1790770362.450885:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790770362.450895:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725595776:12345-0@lo:104: 00010000:00010000:2.0:1790770362.450910:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.450989:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790770362.450995:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725595776:12345-0@lo:104: Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770362.451002:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790770362.451030:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790770362.451038:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.451045:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c0030800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:2.0:1790770362.451049:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.451075:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790770362.451083:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770362.451089:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790770362.451121:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.451128:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790770362.451146:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.451154:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c0030800/0x7379b1d471b86ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86df4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.451173:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770362.451175:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770362.451177:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790770362.451199:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725595904:0@lo:103: 00000100:00100000:2.0:1790770362.451504:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770362.451571:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725595776:0@lo:104: 00010000:00010000:2.0:1790770362.451592:0:5874:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.451652:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725595904 00000100:00100000:0.0:1790770362.451657:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725595904 00010000:00010000:0.0:1790770362.451689:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 14 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770362.451722:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790770362.451728:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf26a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:3322:x1877758725595904:12345-0@lo:103: 00010000:00010000:0.0:1790770362.451740:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790770362.451745:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 14 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451757:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 14 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451773:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1651c00/0x7379b1d471b86df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86ded expref: 14 pid: 5852 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451790:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451799:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790770362.451815:0:5844:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002344850s 00010000:00010000:0.0:1790770362.451821:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451829:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451837:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451843:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451857:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c2007ef600 already unused, calling callback (ffffffffc14cbac0) 00010000:00010000:0.0:1790770362.451862:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451872:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451885:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770362.451894:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790770362.451925:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf26a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3322:x1877758725595904:12345-0@lo:103: Request processed in 198us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770362.451933:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790770362.452072:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725595904:0@lo:103: 00010000:00010000:2.0:1790770362.452092:0:5874:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.452106:0:5874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770362.452113:0:5874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c2007ef600/0x7379b1d471b86e95 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770362.463819:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:6710:x1877758725595520:12345-0@lo:253: Request processed in 66837us (66948us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770362.463837:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790770362.464112:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6710:1877758725595520:0@lo:253: 10000000:01000000:2.0:1790770362.464128:0:6710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790770362.464132:0:6710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790770362.464134:0:6710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790770362.464135:0:6710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790770362.464136:0:6710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790770362.464137:0:6710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790770362.464139:0:6710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790770362.464140:0:6710:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790770362.464142:0:6710:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790770362.464143:0:6710:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790770362.464145:0:6710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790770362.464147:0:6710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790770362.464169:0:6710:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790770362.470178:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790770362.470485:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790770362.470721:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790770362.471126:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790770362.471560:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790770362.471837:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790770362.473266:0:6710:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1790770362.702851:0:6710:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1790770362.702860:0:6710:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1790770362.702895:0:6710:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790770362.702976:0:6710:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790770362.702995:0:6710:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1790770362.703078:0:6710:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790770363.158094:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770364.182291:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770365.206088:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790770365.208910:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790770365.208919:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1c64e1000 from 21 10000000:01000000:1.0:1790770365.208924:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790770365.209128:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.209140:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.209152:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770365.209294:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596032:0@lo:101: 00000100:00100000:1.0:1790770365.209366:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.209469:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790770365.213687:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596032 00000100:00100000:3.0:1790770365.213703:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596032 00000100:00100000:3.0:1790770365.213768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790770365.213778:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:5855:x1877758725596032:12345-0@lo:101: 00010000:00010000:3.0:1790770365.213796:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770365.213825:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86e9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.213857:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.213868:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.213877:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1400800, rc 0) 00000100:00100000:3.0:1790770365.213993:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596032:12345-0@lo:101: Request processed in 217us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770365.214000:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790770365.214145:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596032:0@lo:101: 00010000:00010000:0.0:1790770365.214177:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770365.214188:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770365.214261:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596160:0@lo:501: 00000100:00100000:0.0:1790770365.214299:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770365.214334:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d0883cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.214613:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596160 00000100:00100000:2.0:1790770365.214619:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596160 00000100:00100000:2.0:1790770365.214661:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790770365.214670:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596160:12345-0@lo:501: 00000100:00100000:2.0:1790770365.215068:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596160:12345-0@lo:501: Request processed in 399us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770365.215077:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790770365.215343:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb380700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596160:0@lo:501: 00000100:00100000:2.0:1790770365.215391:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596288:0@lo:503: 00000100:00100000:2.0:1790770365.215442:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.215476:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d003be40 going to sleep for 11 seconds 00000100:00100000:0.0:1790770365.215536:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596288 00000100:00100000:0.0:1790770365.215540:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596288 00000100:00100000:0.0:1790770365.215582:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790770365.215588:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596288:12345-0@lo:503: 00000100:00100000:0.0:1790770365.215903:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596288:12345-0@lo:503: Request processed in 314us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770365.215910:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790770365.216349:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596288:0@lo:503: 00000100:00100000:2.0:1790770365.217649:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6854:1877758725596416:0@lo:502: 00000100:00100000:2.0:1790770365.217715:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.217752:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf2210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770365.217800:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596416 00000100:00100000:3.0:1790770365.217816:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596416 00000100:00100000:3.0:1790770365.217861:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790770365.217870:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6854:x1877758725596416:12345-0@lo:502: 00000100:00100000:3.0:1790770365.219452:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6854:x1877758725596416:12345-0@lo:502: Request processed in 1575us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770365.219464:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790770365.219646:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6854:1877758725596416:0@lo:502: 00000100:00100000:0.0:1790770365.219799:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6854:1877758725596544:0@lo:502: 00000100:00100000:0.0:1790770365.219848:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.219911:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596544 00000100:00100000:2.0:1790770365.219917:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596544 00000100:00100000:2.0:1790770365.219983:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790770365.219991:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6854:x1877758725596544:12345-0@lo:502: 00000100:00100000:0.0:1790770365.220031:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1d08833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.221876:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:6854:x1877758725596544:12345-0@lo:502: Request processed in 1878us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770365.221888:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790770365.222431:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6854:1877758725596544:0@lo:502: 00000040:00080000:0.0:1790770365.222474:0:6854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790770365.222811:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790770365.222833:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790770365.222846:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.222877:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770365.222888:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790770365.222891:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92c1c64e1000 from 4 10000000:01000000:3.0:1790770365.222894:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790770365.222929:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.222937:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770365.223078:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770365.223099:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596672:0@lo:101: 00000100:00100000:3.0:1790770365.223173:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770365.223213:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c65793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.223299:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596672 00000100:00100000:1.0:1790770365.223306:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596672 00000100:00100000:1.0:1790770365.223352:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790770365.223360:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725596672:12345-0@lo:101: 00010000:00010000:1.0:1790770365.223394:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770365.223408:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86eaa expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.223429:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.223439:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.223448:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1650600, rc 0) 00000100:00100000:1.0:1790770365.223493:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725596672:12345-0@lo:101: Request processed in 133us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.223500:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790770365.223623:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596672:0@lo:101: 00010000:00010000:2.0:1790770365.223638:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.223646:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770365.223695:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596800:0@lo:256: 00000100:00100000:2.0:1790770365.223726:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.223750:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf221600 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.223790:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596800 00000100:00100000:1.0:1790770365.223795:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596800 00000100:00100000:1.0:1790770365.223824:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790770365.223832:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725596800:12345-0@lo:256: 20000000:01000000:1.0:1790770365.223845:0:5852:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790770365.223863:0:5852:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790770365.223866:0:5852:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790770365.223971:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725596800:12345-0@lo:256: Request processed in 139us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.223979:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790770365.224008:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596800:0@lo:256: 10000000:01000000:1.0:1790770365.224047:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790770365.224053:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224070:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770365.224078:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1790770365.224079:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1790770365.224082:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1790770365.224099:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224117:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224125:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770365.224138:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596928:0@lo:101: 00000100:00100000:1.0:1790770365.224172:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.224185:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.224197:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725596928 00000100:00100000:1.0:1790770365.224201:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725596928 00000100:00100000:1.0:1790770365.224218:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790770365.224223:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725596928:12345-0@lo:101: 00010000:00010000:1.0:1790770365.224230:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790770365.224239:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86eb8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224253:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224272:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224279:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1651600, rc 0) 00000100:00100000:1.0:1790770365.224308:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725596928:12345-0@lo:101: Request processed in 84us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.224314:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790770365.224341:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725596928:0@lo:101: 00010000:00010000:1.0:1790770365.224350:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.224357:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770365.224410:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597056:0@lo:501: 00000100:00100000:1.0:1790770365.224432:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.224445:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.224456:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597056 00000100:00100000:1.0:1790770365.224459:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597056 00000100:00100000:1.0:1790770365.224476:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790770365.224483:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725597056:12345-0@lo:501: 00000100:00100000:1.0:1790770365.224752:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725597056:12345-0@lo:501: Request processed in 268us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.224759:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790770365.224787:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597056:0@lo:501: 00000100:00100000:1.0:1790770365.224818:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597184:0@lo:503: 00000100:00100000:1.0:1790770365.224861:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.224875:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.224885:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597184 00000100:00100000:1.0:1790770365.224889:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597184 00000100:00100000:1.0:1790770365.224907:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790770365.224912:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725597184:12345-0@lo:503: 00000100:00100000:1.0:1790770365.225223:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725597184:12345-0@lo:503: Request processed in 309us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.225232:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790770365.225269:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597184:0@lo:503: 00000100:00100000:1.0:1790770365.226236:0:6855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6855:1877758725597312:0@lo:502: 00000100:00100000:1.0:1790770365.226291:0:6855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.226353:0:6855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f8b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.226390:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597312 00000100:00100000:2.0:1790770365.226397:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597312 00000100:00100000:2.0:1790770365.226466:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790770365.226475:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:6855:x1877758725597312:12345-0@lo:502: 00000100:00100000:2.0:1790770365.226739:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca8fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:6855:x1877758725597312:12345-0@lo:502: Request processed in 266us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770365.226746:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790770365.226815:0:6855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6855:1877758725597312:0@lo:502: 00000020:01000000:1.0:1790770365.226843:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790770365.226853:0:6855:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1790770365.226861:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790770365.226864:0:6855:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790770365.226872:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790770365.226876:0:6855:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:1.0:1790770365.226905:0:6855:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790770365.226908:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790770365.226933:0:6855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92c1ee5999c0) 00000020:00000080:1.0:1790770365.226995:0:6855:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1790770365.227004:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790770365.227137:0:6855:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790770365.227144:0:6855:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790770365.227168:0:6855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86ecd 00010000:00080000:1.0:1790770365.227202:0:6855:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92c1fb2fb800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1790770365.227489:0:6855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790770365.308005:0:6855:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790770365.308031:0:6855:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790770365.308662:0:6855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790770365.308908:0:6855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790770365.308984:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790770365.309050:0:6855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790770365.310337:0:6860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790770365.310345:0:6860:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790770365.312588:0:6855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790770365.312602:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790770365.312642:0:6855:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790770365.312666:0:6855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7379b1d471b86ed4 00000100:00080000:2.0:1790770365.312676:0:6855:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790770365.312688:0:6855:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92c1fb2fb800 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1790770365.312724:0:6855:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92c1f638c000 x1877758725597440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790770365.312751:0:6855:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1790770365.312906:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1877758725597440:0@lo:8: 00000100:00100000:1.0:1790770365.312998:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1790770365.313111:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790770365.313116:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770365.313118:0:6855:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790770365.313122:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790770365.313126:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770365.313127:0:6855:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790770365.313130:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790770365.313132:0:6855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790770365.313170:0:6855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6855:1877758725597568:0@lo:502: 00000100:00100000:2.0:1790770365.313223:0:6855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.313247:0:6855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf221180 going to sleep for 11 seconds 00000100:00100000:1.0:1790770365.313364:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597568 00000100:00100000:1.0:1790770365.313386:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597568 00000100:00100000:1.0:1790770365.313435:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790770365.313444:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:6855:x1877758725597568:12345-0@lo:502: 00000100:00100000:1.0:1790770365.313665:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca8fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:6855:x1877758725597568:12345-0@lo:502: Request processed in 221us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.313673:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790770365.315367:0:6855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:6855:1877758725597568:0@lo:502: 00000020:01000000:2.0:1790770365.315421:0:6855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790770365.315428:0:6855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770365.315438:0:6855:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790770365.315443:0:6855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790770365.317932:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790770365.317987:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790770365.318000:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.318013:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770365.318023:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790770365.318026:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92c1e2b94d40 from 1 10000000:01000000:1.0:1790770365.318029:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790770365.318067:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.318077:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770365.318088:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770365.318133:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597696:0@lo:101: 00000100:00100000:1.0:1790770365.318210:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.318254:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca5433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.318448:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597696 00000100:00100000:2.0:1790770365.318458:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597696 00000100:00100000:2.0:1790770365.318507:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790770365.318517:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725597696:12345-0@lo:101: 00010000:00010000:2.0:1790770365.318530:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770365.318544:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86edb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.318568:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86edb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.318577:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86edb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.318585:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c29b6000, rc 0) 00000100:00100000:2.0:1790770365.318632:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca8f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725597696:12345-0@lo:101: Request processed in 117us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770365.318639:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790770365.318681:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597696:0@lo:101: 00010000:00010000:2.0:1790770365.318696:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.318704:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770365.318763:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597824:0@lo:501: 00000100:00100000:2.0:1790770365.318789:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.318899:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1cf221a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.318914:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597824 00000100:00100000:2.0:1790770365.318918:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597824 00000100:00100000:2.0:1790770365.318961:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790770365.318969:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725597824:12345-0@lo:501: 00000100:00100000:2.0:1790770365.319349:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca89a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725597824:12345-0@lo:501: Request processed in 379us (558us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790770365.319356:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790770365.319398:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725597824:0@lo:501: 10000000:01000000:2.0:1790770365.319425:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790770365.319433:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770365.319440:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770365.319654:0:6713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597440 00000100:00100000:3.0:1790770365.319658:0:6713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597440 00000100:00100000:3.0:1790770365.319681:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790770365.319686:0:6713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1877758725597440:12345-0@lo:8: 00010000:00080000:3.0:1790770365.319709:0:6713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1790770365.319733:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7379b1d471b86ee9 00002000:00100000:3.0:1790770365.319770:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92c1ffe02800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790770365.319775:0:6713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790770365.319779:0:6713:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1790770365.319899:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1877758725598080:0@lo:400: 00000100:00100000:1.0:1790770365.319932:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.319974:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790770365.319980:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725597952:0@lo:400: 00000100:00100000:1.0:1790770365.320000:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.320022:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598080 00000100:00100000:1.0:1790770365.320026:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598080 00000100:00100000:1.0:1790770365.320058:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725597952 00000100:00100000:1.0:1790770365.320061:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725597952 00000100:00100000:1.0:1790770365.320073:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790770365.320079:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1877758725598080:12345-0@lo:400: 00000100:00100000:1.0:1790770365.320127:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1877758725598080:12345-0@lo:400: Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.320132:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790770365.320144:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790770365.320149:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725597952:12345-0@lo:400: 00000100:00100000:1.0:1790770365.320304:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725597952:12345-0@lo:400: Request processed in 153us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770365.320310:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790770365.320331:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790770365.320354:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee284000 x1877758725597952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770365.320365:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725597952:0@lo:400: 00010000:00080000:1.0:1790770365.320397:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee284700 x1877758725598080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770365.320404:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1877758725598080:0@lo:400: 00002000:00100000:3.0:1790770365.321324:0:6713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790770365.321539:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790770365.321573:0:6713:0:(import.c:65:import_set_state_nolock()) ffff92c1ffe07000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790770365.321649:0:6713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1877758725597440:12345-0@lo:8: Request processed in 1960us (8649us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770365.321658:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790770365.321713:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c000 x1877758725597440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790770375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770365.321723:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790770365.321730:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790770365.321739:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790770365.321744:0:3320:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790770365.321746:0:3320:0:(import.c:65:import_set_state_nolock()) ffff92c1fb2fb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790770365.321758:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790770365.321763:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1877758725597440:0@lo:8: 00000004:00080000:2.0:1790770365.321986:0:6860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790770365.322117:0:6860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224275174313ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790770365.411432:0:5880:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790770365.476136:0:6861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790770365.476184:0:6861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598336:0@lo:7: 00000100:00100000:3.0:1790770365.476254:0:6861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770365.476312:0:6861:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c6579d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790770365.476332:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790770365.476341:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725598208:0@lo:13: 00000100:00100000:3.0:1790770365.476367:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770365.476416:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598336 00000100:00100000:3.0:1790770365.476423:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598336 00000100:00100000:3.0:1790770365.476475:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790770365.476484:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6861:x1877758725598336:12345-0@lo:7: 00000100:00080000:2.0:1790770365.479543:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790770365.479571:0:6716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598208 00000100:00100000:2.0:1790770365.479580:0:6716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598208 00000100:00100000:2.0:1790770365.479635:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790770365.479644:0:6716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1877758725598208:12345-0@lo:13: 00002000:00000024:2.0:1790770365.479675:0:6716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790770365.479764:0:6716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1877758725598208:12345-0@lo:13: Request processed in 120us (3394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770365.479771:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:3.0:1790770365.483679:0:6715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790770365.483694:0:6715:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790770365.484025:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6861:x1877758725598336:12345-0@lo:7: Request processed in 7538us (7767us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770365.484037:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790770365.484093:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee286d80 x1877758725598208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770365.484119:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725598208:0@lo:13: 00010000:00080000:0.0:1790770365.484259:0:6861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee284380 x1877758725598336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790770381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770365.484270:0:6861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598336:0@lo:7: 00000004:00080000:0.0:1790770365.484281:0:6861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1790770365.484323:0:6861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598464:0@lo:5: 00000100:00100000:0.0:1790770365.484368:0:6861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770365.484458:0:6861:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86240 going to sleep for 11 seconds 00000100:00100000:3.0:1790770365.484503:0:6714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598464 00000100:00100000:3.0:1790770365.484510:0:6714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598464 00000100:00100000:3.0:1790770365.484590:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790770365.484598:0:6714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6861:x1877758725598464:12345-0@lo:5: 00002000:00080000:3.0:1790770365.484628:0:6714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790770365.484632:0:6714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790770365.485362:0:6714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6861:x1877758725598464:12345-0@lo:5: Request processed in 763us (991us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790770365.485369:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790770365.485452:0:6861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1fb383800 x1877758725598464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790770381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770365.485465:0:6861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598464:0@lo:5: 00000004:00080000:1.0:1790770365.485473:0:6861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790770365.485500:0:6861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598592:0@lo:700: 00000100:00100000:1.0:1790770365.485526:0:6861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.485554:0:6861:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca543d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.485659:0:6721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598592 00000100:00100000:2.0:1790770365.485665:0:6721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598592 00000100:00100000:2.0:1790770365.485699:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790770365.485706:0:6721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6861:x1877758725598592:12345-0@lo:700: 00000100:00100000:2.0:1790770365.485741:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6721:1877758725598720:0@lo:700: 00000100:00100000:2.0:1790770365.485769:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770365.485985:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2fc4540 going to sleep for 11 seconds 00000100:00100000:2.0:1790770365.486278:0:5865:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598720 00000100:00100000:2.0:1790770365.486283:0:5865:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598720 00000100:00100000:2.0:1790770365.486355:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790770365.486362:0:5865:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6721:x1877758725598720:12345-0@lo:700: 40000000:02000000:3.0:1790770365.578141:0:5865:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1790770365.588111:0:5865:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6721:x1877758725598720:12345-0@lo:700: Request processed in 101738us (102329us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770365.588134:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790770365.590423:0:6721:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c700 x1877758725598720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790770381 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770365.590443:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6721:1877758725598720:0@lo:700: 40000000:02000000:2.0:1790770365.590457:0:6721:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1790770365.730883:0:6737:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790770365.730901:0:6737:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790770365.731144:0:6721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6861:x1877758725598592:12345-0@lo:700: Request processed in 245433us (245611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770365.731201:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790770365.731401:0:6861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1cf1bf480 x1877758725598592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790770381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770365.731414:0:6861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790770365.731432:0:6861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598592:0@lo:700: 00000004:02000040:1.0:1790770365.827105:0:6861:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1790770365.848314:0:6861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598848:0@lo:5: 00000100:00100000:1.0:1790770365.848388:0:6861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770365.848441:0:6861:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca543d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790770365.848548:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598848 00000100:00100000:3.0:1790770365.848557:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598848 00000100:00100000:3.0:1790770365.848620:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790770365.848639:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6861:x1877758725598848:12345-0@lo:5: 00002000:00080000:3.0:1790770365.869190:0:6715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1790770365.869217:0:6715:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1790770365.881341:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6861:x1877758725598848:12345-0@lo:5: Request processed in 32697us (32945us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1790770365.881357:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790770365.881377:0:6861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1cf1bf480 x1877758725598848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790770381 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770365.881396:0:6861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6861:1877758725598848:0@lo:5: 00000004:00080000:1.0:1790770365.881412:0:6861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790770366.235459:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770367.255037:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770368.280070:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770369.302264:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790770369.839723:0:7080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790770370.326349:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790770370.390718:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790770370.390746:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725598976:0@lo:400: 00000100:00100000:3.0:1790770370.390829:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770370.390922:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1877758725599104:0@lo:400: 00000100:00100000:2.0:1790770370.390985:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725598976 00000100:00100000:2.0:1790770370.390995:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725598976 00000100:00100000:3.0:1790770370.391010:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770370.391050:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599104 00000100:00100000:3.0:1790770370.391055:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599104 00000100:00100000:2.0:1790770370.391057:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790770370.391066:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3321:x1877758725598976:12345-0@lo:400: 00000100:00100000:3.0:1790770370.391086:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790770370.391091:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1877758725599104:12345-0@lo:400: 00000100:00100000:2.0:1790770370.391123:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca89bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3321:x1877758725598976:12345-0@lo:400: Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770370.391123:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1877758725599104:12345-0@lo:400: Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770370.391131:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790770370.391131:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790770370.391171:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee284a80 x1877758725599104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770370.391185:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1877758725599104:0@lo:400: 00000100:00100000:3.0:1790770370.391210:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725598976:0@lo:400: 00000100:00100000:3.0:1790770370.391246:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790770370.391253:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1877758725599232:0@lo:400: 00000100:00100000:3.0:1790770370.391291:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770370.391317:0:5860:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599232 00000100:00100000:3.0:1790770370.391321:0:5860:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599232 00000100:00100000:3.0:1790770370.391356:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790770370.391362:0:5860:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1877758725599232:12345-0@lo:400: 00000100:00100000:3.0:1790770370.391417:0:5860:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1877758725599232:12345-0@lo:400: Request processed in 54us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770370.391424:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790770370.391441:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790770370.391469:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725599360:0@lo:400: 00000100:00100000:3.0:1790770370.391494:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770370.391521:0:6714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599360 00000100:00100000:3.0:1790770370.391525:0:6714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599360 00000100:00100000:3.0:1790770370.391556:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790770370.391562:0:6714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1877758725599360:12345-0@lo:400: 00000100:00100000:3.0:1790770370.391597:0:6714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1877758725599360:12345-0@lo:400: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770370.391603:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790770370.391622:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790770370.391637:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee285c00 x1877758725599360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770370.391648:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725599360:0@lo:400: 00010000:00080000:2.0:1790770370.391805:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee286d80 x1877758725599232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770370.391826:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1877758725599232:0@lo:400: 00000100:00100000:3.0:1790770370.908755:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725599488:0@lo:13: 00000100:00100000:3.0:1790770370.908847:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770370.909041:0:6716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599488 00000100:00100000:3.0:1790770370.909049:0:6716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599488 00000100:00100000:3.0:1790770370.909100:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790770370.909109:0:6716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1877758725599488:12345-0@lo:13: 00002000:00000024:3.0:1790770370.909142:0:6716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790770370.909292:0:6716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1877758725599488:12345-0@lo:13: Request processed in 183us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770370.909315:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790770370.909356:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1cf1bf800 x1877758725599488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770370.909375:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725599488:0@lo:13: 00000001:00080000:2.0:1790770371.027006:0:6737:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790770371.350197:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770372.375256:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770373.399804:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790770374.422412:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770375.446992:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790770375.515251:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725599616:0@lo:400: 00000100:00100000:3.0:1790770375.515342:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770375.515401:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790770375.515408:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1877758725599744:0@lo:400: 00000100:00100000:3.0:1790770375.515436:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770375.515466:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1877758725599872:0@lo:400: 00000100:00100000:3.0:1790770375.515490:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770375.515509:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790770375.515514:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725600000:0@lo:400: 00000100:00100000:3.0:1790770375.515536:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770375.524327:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599744 00000100:00100000:1.0:1790770375.524344:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599744 00000100:00100000:1.0:1790770375.524415:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599872 00000100:00100000:1.0:1790770375.524419:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599872 00000100:00100000:1.0:1790770375.524450:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790770375.524461:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1877758725599744:12345-0@lo:400: 00000100:00100000:1.0:1790770375.524563:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1877758725599744:12345-0@lo:400: Request processed in 105us (9126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770375.524571:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790770375.524588:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790770375.524594:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1877758725599872:12345-0@lo:400: 00000100:00100000:1.0:1790770375.524628:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1877758725599872:12345-0@lo:400: Request processed in 34us (9137us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770375.524634:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790770375.524657:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725599616 00000100:00100000:1.0:1790770375.524661:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725599616 00000100:00100000:1.0:1790770375.524693:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790770375.524700:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3323:x1877758725599616:12345-0@lo:400: 00000100:00100000:1.0:1790770375.524732:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca899c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3323:x1877758725599616:12345-0@lo:400: Request processed in 33us (9391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770375.524739:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790770375.524932:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600000 00000100:00100000:3.0:1790770375.524938:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600000 00000100:00100000:3.0:1790770375.524997:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790770375.525005:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1877758725600000:12345-0@lo:400: 00000100:00100000:3.0:1790770375.525046:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1877758725600000:12345-0@lo:400: Request processed in 43us (9509us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770375.525052:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790770375.525070:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790770375.525075:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790770375.525112:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee287b80 x1877758725600000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770375.525123:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1790770375.525148:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725600000:0@lo:400: 00010000:00080000:3.0:1790770375.525164:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee285f80 x1877758725599872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770375.525173:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1877758725599872:0@lo:400: 00010000:00080000:3.0:1790770375.525215:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1ee285500 x1877758725599744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770375.525225:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1877758725599744:0@lo:400: 00000100:00100000:3.0:1790770375.525235:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725599616:0@lo:400: 00000100:00100000:3.0:1790770376.022378:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725600128:0@lo:13: 00000100:00100000:3.0:1790770376.022467:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770376.022585:0:6716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600128 00000100:00100000:2.0:1790770376.022594:0:6716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600128 00000100:00100000:2.0:1790770376.022659:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770376.022668:0:6716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725600128:12345-0@lo:13: 00002000:00000024:2.0:1790770376.022704:0:6716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790770376.022751:0:6716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725600128:12345-0@lo:13: Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770376.022758:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790770376.023251:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c700 x1877758725600128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770376.023270:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725600128:0@lo:13: 00010000:00010000:3.0:1790770376.474322:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770377.500219:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770378.518627:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770379.547265:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770380.574411:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790770380.630510:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725600256:0@lo:400: 00000100:00100000:2.0:1790770380.630585:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770380.630630:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790770380.630635:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725600640:0@lo:400: 00000100:00100000:2.0:1790770380.630661:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770380.630684:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1877758725600512:0@lo:400: 00000100:00100000:2.0:1790770380.630711:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770380.630728:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790770380.630732:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1877758725600384:0@lo:400: 00000100:00100000:2.0:1790770380.630749:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770380.630774:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600256 00000100:00100000:2.0:1790770380.630781:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600256 00000100:00100000:2.0:1790770380.630820:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790770380.630827:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3324:x1877758725600256:12345-0@lo:400: 00000100:00100000:2.0:1790770380.631404:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca899850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3324:x1877758725600256:12345-0@lo:400: Request processed in 574us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770380.631413:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790770380.631448:0:6713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600640 00000100:00100000:2.0:1790770380.631452:0:6713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600640 00000100:00100000:2.0:1790770380.631486:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770380.631493:0:6713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725600640:12345-0@lo:400: 00000100:00100000:2.0:1790770380.631521:0:6713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725600640:12345-0@lo:400: Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770380.631527:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790770380.631542:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600512 00000100:00100000:2.0:1790770380.631545:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600512 00000100:00100000:2.0:1790770380.631569:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600384 00000100:00100000:2.0:1790770380.631571:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600384 00000100:00100000:2.0:1790770380.631581:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790770380.631586:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1877758725600512:12345-0@lo:400: 00000100:00100000:2.0:1790770380.631615:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1877758725600512:12345-0@lo:400: Request processed in 28us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770380.631620:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790770380.631629:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790770380.631634:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1877758725600384:12345-0@lo:400: 00000100:00100000:2.0:1790770380.631653:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1877758725600384:12345-0@lo:400: Request processed in 19us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770380.631658:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790770380.631676:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790770380.631680:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790770380.631711:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638f100 x1877758725600384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770380.631732:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1877758725600384:0@lo:400: 00010000:00080000:2.0:1790770380.631743:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c700 x1877758725600512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770380.631752:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1877758725600512:0@lo:400: 00010000:00080000:1.0:1790770380.631825:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c000 x1877758725600640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770380.631834:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725600640:0@lo:400: 00000100:00100000:1.0:1790770380.631842:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725600256:0@lo:400: 00000100:00100000:3.0:1790770381.143505:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790770381.143543:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725600768:0@lo:13: 00000100:00100000:3.0:1790770381.143635:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770381.144614:0:6716:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600768 00000100:00100000:2.0:1790770381.144626:0:6716:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600768 00000100:00100000:2.0:1790770381.144682:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790770381.144691:0:6716:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725600768:12345-0@lo:13: 00002000:00000024:2.0:1790770381.144734:0:6716:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790770381.144809:0:6716:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725600768:12345-0@lo:13: Request processed in 120us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770381.144817:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790770381.144875:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1f638c700 x1877758725600768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770381.144896:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725600768:0@lo:13: 00010000:00010000:1.0:1790770381.590232:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790770382.020591:0:7654:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790770382.020596:0:7654:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790770382.020714:0:7654:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92c1ffe34000 00000020:01000004:3.0:1790770382.020731:0:7654:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790770382.020744:0:7654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790770382.020768:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92c1f60719c0) 00000020:00000080:3.0:1790770382.020784:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790770382.034221:0:7654:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1790770382.034484:0:7654:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1790770382.051777:0:7654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790770382.057636:0:7654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790770382.057816:0:7654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1790770382.058259:0:7654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790770382.058308:0:7654:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1790770382.058694:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1790770382.058706:0:7654:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790770382.058715:0:7654:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7379b1d471b86ef7 00000020:01000004:1.0:1790770382.058722:0:7654:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1790770382.058742:0:7654:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1790770382.058746:0:7654:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1790770382.058753:0:7654:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1790770382.058774:0:7654:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1790770382.058778:0:7654:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790770382.076476:0:7654:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790770382.076522:0:7654:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.126@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1790770382.076526:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790770382.076528:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790770382.076530:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790770382.076531:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790770382.076532:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790770382.076534:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790770382.076535:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790770382.076537:0:7654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790770382.076538:0:7654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790770382.076540:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790770382.076541:0:7654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790770382.076548:0:7654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1790770382.076550:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790770382.076551:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790770382.076552:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790770382.076553:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790770382.076554:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790770382.076554:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790770382.076555:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790770382.076556:0:7654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790770382.076557:0:7654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790770382.076558:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790770382.076558:0:7654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790770382.076585:0:7654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790770382.076603:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725600896:0@lo:253: 00000100:00100000:1.0:1790770382.076680:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.076778:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca543cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.076820:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725600896 00000100:00100000:2.0:1790770382.076828:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725600896 00000100:00100000:0.0:1790770382.076923:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790770382.076935:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:7654:x1877758725600896:12345-0@lo:253: 20000000:01000000:0.0:1790770382.077155:0:5852:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790770382.077159:0:5852:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790770382.077164:0:5852:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790770382.077167:0:5852:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1790770382.078469:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790770382.078685:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1790770382.078699:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1790770382.078736:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1790770382.078744:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1790770382.078771:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1790770382.078832:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1790770382.079460:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1790770382.079481:0:5852:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1790770382.079483:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1790770382.079513:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1790770382.079519:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790770382.079567:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1790770382.079575:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1790770382.079603:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1790770382.079611:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790770382.079634:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1790770382.079680:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1790770382.080729:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1790770382.080747:0:5852:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.126@tcp 20000000:01000000:0.0:1790770382.080749:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.126@tcp (null) (null) (null) 00000040:00080000:0.0:1790770382.080775:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1790770382.080781:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790770382.080804:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1790770382.080809:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.126@tcp (null) (null) 00000040:00080000:0.0:1790770382.080832:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1790770382.080838:0:5852:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1790770382.080872:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1790770382.080900:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1790770382.080913:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1790770382.080916:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1790770382.080922:0:5852:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790770382.080924:0:5852:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790770382.080926:0:5852:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790770382.080937:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790770382.081012:0:5852:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790770382.081043:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790770382.081046:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790770382.081737:0:7656:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790770382.081787:0:7656:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790770382.081834:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1790770382.082685:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1790770382.082729:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1790770382.082760:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1790770382.082772:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790770382.082775:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790770382.084025:0:7657:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1790770382.084130:0:7657:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1790770382.084163:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790770382.084929:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790770382.085114:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790770382.085175:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790770382.085189:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790770382.085192:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1790770382.085864:0:7658:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790770382.085912:0:7658:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790770382.086224:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790770382.086489:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790770382.086532:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790770382.086592:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790770382.086608:0:5852:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790770382.086611:0:5852:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790770382.087287:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1790770382.087759:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1790770382.087803:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1790770382.088130:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1790770382.088152:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790770382.088171:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088190:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088198:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088204:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088212:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088220:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86edb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088228:0:5852:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088266:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.088282:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 16 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.088298:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601024:0@lo:104: 00000100:00100000:2.0:1790770382.088375:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.088711:0:5842:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790770382.088729:0:5842:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601024 00000100:00100000:0.0:1790770382.088737:0:5842:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601024 00000100:00100000:0.0:1790770382.088793:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790770382.088804:0:5842:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c563a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5852:x1877758725601024:12345-0@lo:104: 00010000:00010000:0.0:1790770382.088817:0:5842:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.089100:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790770382.089107:0:5842:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c563a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5852:x1877758725601024:12345-0@lo:104: Request processed in 305us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.089115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1790770382.089223:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790770382.089230:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.089238:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1651c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1790770382.089241:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.089249:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790770382.089256:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770382.089261:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790770382.089302:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.089308:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790770382.089364:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725601152:0@lo:103: 00000100:00100000:1.0:1790770382.089408:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790770382.089523:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.089549:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 16 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.089560:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601280:0@lo:104: 00010000:00010000:3.0:1790770382.089915:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.089924:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1651c00/0x7379b1d471b86edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ee2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.089965:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770382.089967:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770382.089980:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790770382.090142:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790770382.090193:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.090202:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 16 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.090212:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601408:0@lo:104: 00000100:00100000:2.0:1790770382.090235:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790770382.090263:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.090272:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 16 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.090280:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601536:0@lo:104: 00000100:00100000:2.0:1790770382.090298:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790770382.090313:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.090321:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 16 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.090329:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601664:0@lo:104: 00000100:00100000:2.0:1790770382.090355:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.090366:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.090387:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601024:0@lo:104: 00000100:00100000:0.0:1790770382.090490:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601280 00000100:00100000:0.0:1790770382.090496:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601280 00000100:00100000:0.0:1790770382.090525:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601408 00000100:00100000:0.0:1790770382.090528:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601408 00000100:00100000:0.0:1790770382.090536:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601536 00000100:00100000:0.0:1790770382.090539:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601536 00000100:00100000:0.0:1790770382.090548:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601664 00000100:00100000:0.0:1790770382.090550:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601664 00000100:00100000:0.0:1790770382.090561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790770382.090569:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5852:x1877758725601280:12345-0@lo:104: 00010000:00010000:0.0:1790770382.090580:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.090636:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790770382.090642:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+6:5852:x1877758725601280:12345-0@lo:104: Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.090649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790770382.090671:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790770382.090676:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5852:x1877758725601408:12345-0@lo:104: 00010000:00010000:0.0:1790770382.090685:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.090717:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790770382.090722:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+5:5852:x1877758725601408:12345-0@lo:104: Request processed in 47us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.090728:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790770382.090740:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790770382.090745:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+4:5852:x1877758725601536:12345-0@lo:104: 00010000:00010000:0.0:1790770382.090752:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.090775:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790770382.090780:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+4:5852:x1877758725601536:12345-0@lo:104: Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.090785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790770382.090794:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790770382.090799:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5852:x1877758725601664:12345-0@lo:104: 00010000:00010000:0.0:1790770382.090806:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.090840:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1790770382.090845:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5852:x1877758725601664:12345-0@lo:104: Request processed in 46us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.090850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790770382.091100:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601280:0@lo:104: 00000100:00100000:2.0:1790770382.091109:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601408:0@lo:104: 00000100:00100000:2.0:1790770382.091115:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601536:0@lo:104: 00000100:00100000:2.0:1790770382.091120:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5852:1877758725601664:0@lo:104: 00010000:00010000:2.0:1790770382.091147:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091205:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790770382.091211:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091219:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1651800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1790770382.091223:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091231:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790770382.091239:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770382.091243:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790770382.091276:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091281:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790770382.091294:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091299:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86eb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ebf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091310:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790770382.091313:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091319:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1651000 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1790770382.091328:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091335:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790770382.091341:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770382.091346:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790770382.091360:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091365:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790770382.091381:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091387:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86e9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86ea3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091396:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790770382.091399:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091405:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c29b6a00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1790770382.091408:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091415:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790770382.091431:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770382.091436:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790770382.091450:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091456:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790770382.091462:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091468:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6a00/0x7379b1d471b86e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e79 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091478:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790770382.091481:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091487:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1401c00 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:3.0:1790770382.091490:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091497:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790770382.091503:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770382.091509:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790770382.091528:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091534:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790770382.091539:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091546:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1401c00/0x7379b1d471b86e48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86e4f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091562:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770382.091564:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770382.091566:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790770382.091578:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725601920:0@lo:103: 00000100:00100000:3.0:1790770382.091616:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770382.091648:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790770382.091654:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725602048:0@lo:103: 00000100:00100000:3.0:1790770382.091674:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770382.091701:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601152 00000100:00100000:3.0:1790770382.091706:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601152 00010000:00010000:3.0:1790770382.091727:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 17 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.091743:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601920 00000100:00100000:3.0:1790770382.091745:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601920 00010000:00010000:3.0:1790770382.091754:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 18 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.091763:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602048 00000100:00100000:3.0:1790770382.091765:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602048 00010000:00010000:3.0:1790770382.091773:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 19 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.091793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790770382.091800:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+19:3321:x1877758725601152:12345-0@lo:103: 00010000:00010000:3.0:1790770382.091811:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790770382.091815:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 19 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091825:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 19 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091915:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c29b6000/0x7379b1d471b86ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86edb expref: 19 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.091928:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770382.091980:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:3321:x1877758725601152:12345-0@lo:103: Request processed in 180us (2573us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.092118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790770382.092134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790770382.092140:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+17:3323:x1877758725601920:12345-0@lo:103: 00010000:00010000:3.0:1790770382.092148:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790770382.092152:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 17 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092160:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 17 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092169:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86ea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86e9c expref: 17 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092189:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770382.092312:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee286680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:3323:x1877758725601920:12345-0@lo:103: Request processed in 172us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.092319:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790770382.092331:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790770382.092337:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ee285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:3323:x1877758725602048:12345-0@lo:103: 00010000:00010000:3.0:1790770382.092344:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790770382.092348:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 15 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092356:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 15 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092366:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1401e00/0x7379b1d471b86e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86e72 expref: 15 pid: 5851 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092375:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770382.092397:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ee285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:3323:x1877758725602048:12345-0@lo:103: Request processed in 60us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.092402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790770382.092424:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725601792:0@lo:103: 00000100:00100000:3.0:1790770382.092468:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770382.092504:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790770382.092511:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725602176:0@lo:103: 00000100:00100000:3.0:1790770382.092531:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770382.092553:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725601792 00000100:00100000:3.0:1790770382.092557:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725601792 00010000:00010000:3.0:1790770382.092576:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 14 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.092589:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602176 00000100:00100000:3.0:1790770382.092592:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602176 00010000:00010000:3.0:1790770382.092601:0:5843:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 15 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.092611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790770382.092616:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1eebaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:3322:x1877758725601792:12345-0@lo:103: 00010000:00010000:3.0:1790770382.092623:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790770382.092627:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 15 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092635:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 15 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092645:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1651600/0x7379b1d471b86ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86eb8 expref: 15 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092656:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770382.092680:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1eebaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:3322:x1877758725601792:12345-0@lo:103: Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.092687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790770382.092697:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790770382.092703:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1eeba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3322:x1877758725602176:12345-0@lo:103: 00010000:00010000:3.0:1790770382.092710:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790770382.092714:0:5843:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 13 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092735:0:5843:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 13 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092744:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86e4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86e48 expref: 13 pid: 5852 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092757:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092778:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092786:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092793:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092799:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092805:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c29b7e00 already unused, calling callback (ffffffffc14cbac0) 00010000:00010000:3.0:1790770382.092809:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092817:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092918:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.092928:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790770382.092978:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1eeba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3322:x1877758725602176:12345-0@lo:103: Request processed in 274us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.092984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790770382.093023:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725602176:0@lo:103: 00000100:00100000:3.0:1790770382.093031:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725601792:0@lo:103: 00010000:00010000:3.0:1790770382.093069:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.093079:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.093086:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86efe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790770382.093102:0:5852:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1790770382.094021:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790770382.094544:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725601152:0@lo:103: 00000100:00100000:2.0:1790770382.094675:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725601920:0@lo:103: 00000100:00100000:2.0:1790770382.094707:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ee286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3323:1877758725602048:0@lo:103: 00000100:00100000:3.0:1790770382.131456:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca89a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:7654:x1877758725600896:12345-0@lo:253: Request processed in 54510us (54762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.131473:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790770382.131566:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725600896:0@lo:253: 10000000:01000000:1.0:1790770382.131582:0:7654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790770382.131586:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790770382.131587:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790770382.131589:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790770382.131590:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1790770382.131591:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790770382.131593:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790770382.131594:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790770382.131596:0:7654:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790770382.131598:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790770382.131599:0:7654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790770382.131620:0:7654:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92c1ffe34000 from lustre-OST0001 10000000:01000000:1.0:1790770382.131646:0:7654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790770382.131663:0:7654:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790770382.131672:0:7654:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92c1e2b94d40 local copy 10000000:01000000:1.0:1790770382.131676:0:7654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790770382.131729:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.131740:0:7654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.131749:0:7654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.131768:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602304:0@lo:101: 00000100:00100000:1.0:1790770382.131805:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.131915:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602304 00000100:00100000:2.0:1790770382.131922:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602304 00000100:00100000:2.0:1790770382.131987:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790770382.131997:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+11:7654:x1877758725602304:12345-0@lo:101: 00010000:00010000:2.0:1790770382.132011:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770382.132025:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c29b7600/0x7379b1d471b86f0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f05 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.132059:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b7600/0x7379b1d471b86f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f05 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.132070:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c29b7600/0x7379b1d471b86f0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f05 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.132080:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c29b7600, rc 0) 00000100:00100000:2.0:1790770382.132113:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca89b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:7654:x1877758725602304:12345-0@lo:101: Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.132119:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790770382.132244:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bc480 going to sleep for 11 seconds 00000100:00100000:1.0:1790770382.132255:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602304:0@lo:101: 00010000:00010000:1.0:1790770382.132266:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.132275:0:7654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.132360:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602432:0@lo:501: 00000100:00100000:1.0:1790770382.132385:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.132443:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1790770382.132597:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602432 00000100:00100000:3.0:1790770382.132602:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602432 00000100:00100000:3.0:1790770382.132665:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790770382.132672:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:7654:x1877758725602432:12345-0@lo:501: 00000100:00100000:1.0:1790770382.133060:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602432:0@lo:501: 10000000:01000000:1.0:1790770382.133073:0:7654:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790770382.133099:0:7654:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790770382.133104:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.133117:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.133123:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.133148:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790770382.133170:0:7654:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92c1ffe34000 10000000:01000000:1.0:1790770382.133174:0:7654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790770382.133180:0:7654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790770382.133183:0:7654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790770382.133187:0:7654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790770382.133190:0:7654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790770382.133208:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.133215:0:7654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.133223:0:7654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.133236:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602560:0@lo:101: 00010000:00010000:0.0:1790770382.133347:0:5847:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790770382.133354:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.133362:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1651600 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:0.0:1790770382.133366:0:5847:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.133374:0:5847:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790770382.133382:0:5847:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790770382.133388:0:5847:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1790770382.133406:0:5847:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.133413:0:5847:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790770382.133439:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.133447:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1651600/0x7379b1d471b86f05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7379b1d471b86f0c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.133458:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770382.133459:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770382.133461:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770382.133469:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790770382.133480:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725602688:0@lo:103: 00000100:00100000:1.0:1790770382.133576:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.133606:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.133656:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602560 00000100:00100000:2.0:1790770382.133660:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602560 00000100:00100000:2.0:1790770382.133692:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790770382.133700:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602560:12345-0@lo:101: 00010000:00010000:2.0:1790770382.133707:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770382.133718:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c29b7a00/0x7379b1d471b86f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f13 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.133735:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b7a00/0x7379b1d471b86f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f13 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.133745:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c29b7a00/0x7379b1d471b86f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f13 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.133752:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c29b7a00, rc 0) 00000100:00100000:2.0:1790770382.133780:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725602560:12345-0@lo:101: Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.133787:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790770382.133848:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca89ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602432:12345-0@lo:501: Request processed in 1175us (1461us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790770382.133863:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790770382.133992:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602560:0@lo:101: 00010000:00010000:1.0:1790770382.134004:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f1a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.134021:0:7654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f1a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.134093:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602816:0@lo:501: 00000100:00100000:1.0:1790770382.134117:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.134142:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.134190:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602816 00000100:00100000:2.0:1790770382.134193:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602816 00000100:00100000:2.0:1790770382.134223:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790770382.134229:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602816:12345-0@lo:501: 00000100:00100000:2.0:1790770382.134426:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602816:12345-0@lo:501: Request processed in 197us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.134433:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790770382.134506:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602816:0@lo:501: 00000100:00100000:1.0:1790770382.134532:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602944:0@lo:503: 00000100:00100000:1.0:1790770382.134571:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.134593:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.134642:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602944 00000100:00100000:2.0:1790770382.134652:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602944 00000100:00100000:2.0:1790770382.134683:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790770382.134690:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602944:12345-0@lo:503: 00000100:00100000:2.0:1790770382.134841:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725602944:12345-0@lo:503: Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.134848:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790770382.134999:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725602944:0@lo:503: 00000040:00080000:1.0:1790770382.135264:0:7654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790770382.135330:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603072:0@lo:502: 00000100:00100000:1.0:1790770382.135364:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.135391:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770382.135457:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603072 00000100:00100000:3.0:1790770382.135462:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603072 00000100:00100000:3.0:1790770382.135493:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790770382.135500:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603072:12345-0@lo:502: 00000100:00100000:3.0:1790770382.135637:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603072:12345-0@lo:502: Request processed in 138us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.135644:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790770382.135729:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603072:0@lo:502: 00000040:00080000:1.0:1790770382.136111:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790770382.136166:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790770382.136210:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790770382.136257:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790770382.136290:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790770382.136321:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790770382.136347:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603200:0@lo:502: 00000100:00100000:1.0:1790770382.136390:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.136405:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.136480:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603200 00000100:00100000:2.0:1790770382.136486:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603200 00000100:00100000:2.0:1790770382.136521:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790770382.136529:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603200:12345-0@lo:502: 00000100:00100000:2.0:1790770382.136662:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603200:12345-0@lo:502: Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.136669:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790770382.136796:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603200:0@lo:502: 00000040:00080000:1.0:1790770382.136987:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790770382.137000:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:0.0:1790770382.137397:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.137491:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725602688 00000100:00100000:2.0:1790770382.137496:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725602688 00000100:00100000:2.0:1790770382.137538:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790770382.137546:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3321:x1877758725602688:12345-0@lo:103: 00010000:00010000:2.0:1790770382.137558:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790770382.137576:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c29b7600/0x7379b1d471b86f0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7379b1d471b86f05 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.137590:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790770382.137622:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:3321:x1877758725602688:12345-0@lo:103: Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.137628:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790770382.137691:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3321:1877758725602688:0@lo:103: 00000020:01000000:3.0:1790770382.138215:0:7662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790770382.138223:0:7662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1790770382.138230:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.138232:0:7662:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790770382.138239:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790770382.138255:0:7662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92c1f6074d40) 00000020:00000080:3.0:1790770382.138276:0:7662:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790770382.138282:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790770382.138340:0:7662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92c1ffe34000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790770382.138348:0:7662:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790770382.138353:0:7662:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7379b1d471b86f28 00010000:00010000:3.0:1790770382.142195:0:7662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1790770382.142525:0:7662:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790770382.144705:0:7662:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790770382.145221:0:7662:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790770382.148398:0:7662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790770382.149103:0:7662:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790770382.150303:0:7662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1790770382.150316:0:7662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790770382.150324:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.150326:0:7662:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1790770382.150338:0:7662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790770382.150343:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.150344:0:7662:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790770382.150347:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790770382.150348:0:7662:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790770382.150396:0:7662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790770382.150400:0:7662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.150402:0:7662:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790770382.150405:0:7662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790770382.151982:0:7654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1790770382.152017:0:7654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1790770382.152038:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f1a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152067:0:7654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1651000/0x7379b1d471b86f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f1a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770382.152075:0:7654:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92c1ffe34000 from 1 10000000:01000000:2.0:1790770382.152078:0:7654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790770382.152117:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152125:0:7654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152137:0:7654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.152159:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603328:0@lo:101: 00000100:00100000:2.0:1790770382.152224:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.152262:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aee180 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.152283:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603328 00000100:00100000:2.0:1790770382.152290:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603328 00000100:00100000:2.0:1790770382.152335:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790770382.152343:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+12:7654:x1877758725603328:12345-0@lo:101: 00010000:00010000:2.0:1790770382.152356:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770382.152368:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c29b7800/0x7379b1d471b86f36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f2f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152390:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b7800/0x7379b1d471b86f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f2f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152401:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c29b7800/0x7379b1d471b86f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f2f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152416:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c29b7800, rc 0) 00000100:00100000:2.0:1790770382.152459:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603328:12345-0@lo:101: Request processed in 116us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.152465:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790770382.152514:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603328:0@lo:101: 00010000:00010000:2.0:1790770382.152530:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f36 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.152538:0:7654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f36 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.152633:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603456:0@lo:501: 00000100:00100000:2.0:1790770382.152657:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.152674:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aee180 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.153023:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603456 00000100:00100000:2.0:1790770382.153028:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603456 00000100:00100000:2.0:1790770382.153073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790770382.153080:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603456:12345-0@lo:501: 00000100:00100000:2.0:1790770382.153326:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603456:12345-0@lo:501: Request processed in 246us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.153333:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790770382.153368:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603456:0@lo:501: 00000100:00100000:2.0:1790770382.153396:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603584:0@lo:503: 00000100:00100000:2.0:1790770382.153433:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.153453:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603584 00000100:00100000:2.0:1790770382.153464:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603584 00000100:00100000:2.0:1790770382.153487:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790770382.153493:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603584:12345-0@lo:503: 00000100:00100000:2.0:1790770382.153760:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603584:12345-0@lo:503: Request processed in 267us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.153768:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790770382.153810:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aee180 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.153822:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603584:0@lo:503: 00000040:00080000:2.0:1790770382.155443:0:7654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790770382.155520:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603712:0@lo:502: 00000100:00100000:2.0:1790770382.155579:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770382.155656:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aee180 going to sleep for 11 seconds 00000100:00100000:3.0:1790770382.157582:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603712 00000100:00100000:3.0:1790770382.157595:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603712 00000100:00100000:3.0:1790770382.157643:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790770382.157652:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603712:12345-0@lo:502: 00000100:00100000:3.0:1790770382.157976:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603712:12345-0@lo:502: Request processed in 324us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.157984:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790770382.158194:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603712:0@lo:502: 00000040:00080000:1.0:1790770382.158485:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1790770382.158546:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1790770382.158584:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603840:0@lo:502: 00000100:00100000:1.0:1790770382.158629:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.158668:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4efa240 going to sleep for 11 seconds 00000100:00100000:0.0:1790770382.158737:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603840 00000100:00100000:0.0:1790770382.158743:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603840 00000100:00100000:0.0:1790770382.158784:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790770382.158792:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603840:12345-0@lo:502: 00000100:00100000:0.0:1790770382.159097:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603840:12345-0@lo:502: Request processed in 305us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.159105:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790770382.159194:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603840:0@lo:502: 00000040:00080000:1.0:1790770382.159289:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790770382.159301:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1790770382.159761:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790770382.159771:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.159773:0:7666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790770382.159780:0:7666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92c1ffe34000 00000020:00000080:3.0:1790770382.159782:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790770382.159801:0:7666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790770382.159804:0:7666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770382.159805:0:7666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790770382.159808:0:7666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1790770382.160025:0:7654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790770382.160055:0:7654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790770382.160075:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f36 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.160086:0:7654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6c00/0x7379b1d471b86f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f36 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770382.160125:0:7654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790770382.160128:0:7654:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92c1ffe34000 10000000:01000000:1.0:1790770382.160130:0:7654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92c1ffe34000 10000000:01000000:1.0:1790770382.160134:0:7654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790770382.160139:0:7654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1ffe34000 from 1 10000000:01000000:1.0:1790770382.160142:0:7654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790770382.160169:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.160187:0:7654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.160196:0:7654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.160211:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603968:0@lo:101: 00000100:00100000:1.0:1790770382.160251:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.160282:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4efa180 going to sleep for 11 seconds 00000100:00100000:0.0:1790770382.160347:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725603968 00000100:00100000:0.0:1790770382.160352:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725603968 00000100:00100000:0.0:1790770382.160381:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790770382.160388:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725603968:12345-0@lo:101: 00010000:00010000:0.0:1790770382.160398:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770382.160409:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c2007eea00/0x7379b1d471b86f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f3d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.160430:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c2007eea00/0x7379b1d471b86f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f3d expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.160440:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c2007eea00/0x7379b1d471b86f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f3d expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.160447:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c2007eea00, rc 0) 00000100:00100000:0.0:1790770382.160480:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725603968:12345-0@lo:101: Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.160486:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790770382.160524:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725603968:0@lo:101: 00010000:00010000:0.0:1790770382.160537:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f44 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.160551:0:7654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f44 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770382.160613:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604096:0@lo:501: 00000100:00100000:0.0:1790770382.160637:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.160648:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c96520c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770382.160744:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604096 00000100:00100000:3.0:1790770382.160748:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604096 00000100:00100000:3.0:1790770382.160776:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790770382.160782:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604096:12345-0@lo:501: 00000100:00100000:3.0:1790770382.161418:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604096:12345-0@lo:501: Request processed in 634us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.161435:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790770382.161568:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604096:0@lo:501: 00000100:00100000:1.0:1790770382.161602:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604224:0@lo:503: 00000100:00100000:1.0:1790770382.161644:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.161680:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4efa000 going to sleep for 11 seconds 00000100:00100000:0.0:1790770382.161735:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604224 00000100:00100000:0.0:1790770382.161739:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604224 00000100:00100000:0.0:1790770382.161774:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790770382.161781:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604224:12345-0@lo:503: 00000100:00100000:0.0:1790770382.162246:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604224:12345-0@lo:503: Request processed in 465us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.162254:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790770382.162759:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604224:0@lo:503: 00000040:00080000:1.0:1790770382.165152:0:7654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790770382.165236:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604352:0@lo:502: 00000100:00100000:1.0:1790770382.165311:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.165409:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4efa000 going to sleep for 11 seconds 00000100:00100000:0.0:1790770382.165630:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604352 00000100:00100000:0.0:1790770382.165638:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604352 00000100:00100000:0.0:1790770382.165718:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790770382.165728:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604352:12345-0@lo:502: 00000100:00100000:0.0:1790770382.166090:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604352:12345-0@lo:502: Request processed in 362us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.166098:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790770382.166630:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604352:0@lo:502: 00000040:00080000:1.0:1790770382.166932:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790770382.167020:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790770382.167070:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790770382.167132:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790770382.167175:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790770382.167223:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790770382.167261:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790770382.167313:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790770382.167362:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790770382.167399:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790770382.167435:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790770382.167492:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790770382.167531:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790770382.167564:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790770382.167611:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790770382.167649:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790770382.167683:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790770382.167733:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790770382.167769:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790770382.167802:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790770382.167852:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790770382.167891:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790770382.167926:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790770382.168034:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790770382.168086:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790770382.168119:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790770382.168181:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790770382.168221:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790770382.168258:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790770382.168309:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790770382.168348:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790770382.168384:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790770382.168428:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790770382.168483:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790770382.168521:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790770382.168571:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790770382.168609:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790770382.168654:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604480:0@lo:502: 00000100:00100000:1.0:1790770382.168731:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.168795:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4efa000 going to sleep for 11 seconds 00000100:00100000:2.0:1790770382.168910:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604480 00000100:00100000:2.0:1790770382.168920:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604480 00000100:00100000:2.0:1790770382.169058:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790770382.169069:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604480:12345-0@lo:502: 00000100:00100000:2.0:1790770382.169457:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725604480:12345-0@lo:502: Request processed in 390us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770382.169466:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790770382.169518:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725604480:0@lo:502: 00000040:00080000:1.0:1790770382.169657:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1790770382.169672:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790770382.170868:0:7667:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790770382.170884:0:7667:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92c1ee59cd40) 00000020:00000080:1.0:1790770382.170906:0:7667:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790770382.172020:0:7667:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92c1ffe34000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790770382.172026:0:7667:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92c1ffe34000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790770382.172029:0:7667:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92c1ffe34000 3 00010000:00080000:1.0:1790770382.172998:0:7667:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92c2009a9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.126@tcp at head 00010000:00010000:1.0:1790770382.174628:0:7667:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1790770382.174874:0:7667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790770382.174913:0:7667:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790770382.174926:0:7667:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7379b1d471b86f52 00000100:00080000:1.0:1790770382.174937:0:7667:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790770382.174993:0:7667:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92c2009a9000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:1.0:1790770382.175038:0:7667:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92c1cf1bc700 x1877758725604608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790770382.175081:0:7667:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790770382.175120:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1877758725604608:0@lo:38: 00000100:00100000:2.0:1790770382.175210:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.175242:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604608 00000100:00100000:1.0:1790770382.175250:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604608 00000100:00100000:1.0:1790770382.175288:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790770382.175295:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3320:x1877758725604608:12345-0@lo:38: 00010000:00080000:1.0:1790770382.175319:0:5859:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1790770382.175348:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7379b1d471b86f59 00000100:00100000:0.0:1790770382.176541:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1877758725604864:0@lo:400: 00000100:00100000:0.0:1790770382.176591:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.176620:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790770382.176625:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725604736:0@lo:400: 00000100:00100000:0.0:1790770382.176647:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.176670:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790770382.176679:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725604992:0@lo:400: 00000100:00100000:0.0:1790770382.176704:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.176732:0:5860:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790770382.176740:0:5860:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790770382.176759:0:6714:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604992 00000100:00100000:0.0:1790770382.176765:0:6714:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604992 00000100:00100000:0.0:1790770382.176812:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790770382.176820:0:6714:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1877758725604992:12345-0@lo:400: 00000100:00100000:0.0:1790770382.176873:0:6714:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1877758725604992:12345-0@lo:400: Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.176881:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790770382.176901:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790770382.176930:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1fb382680 x1877758725604992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770382.176978:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1877758725604992:0@lo:400: 00000100:00100000:0.0:1790770382.178302:0:5858:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790770382.178317:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604864 00000100:00100000:0.0:1790770382.178323:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604864 00000100:00100000:0.0:1790770382.178362:0:5858:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790770382.178367:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725604736 00000100:00100000:0.0:1790770382.178369:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725604736 00000100:00100000:0.0:1790770382.178380:0:5858:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790770382.178390:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790770382.178397:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1877758725604864:12345-0@lo:400: 00000100:00100000:0.0:1790770382.178461:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1877758725604864:12345-0@lo:400: Request processed in 64us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.178467:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790770382.178479:0:5858:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790770382.178493:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790770382.178499:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725604736:12345-0@lo:400: 00000100:00100000:0.0:1790770382.178526:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1877758725604736:12345-0@lo:400: Request processed in 27us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.178531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790770382.178545:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790770382.178570:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1fb381c00 x1877758725604736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770382.178581:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1877758725604736:0@lo:400: 00010000:00080000:0.0:1790770382.178592:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1fb381f80 x1877758725604864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770382.178600:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1877758725604864:0@lo:400: 00000004:00100000:1.0:1790770382.181176:0:5859:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790770382.181245:0:5859:0:(import.c:65:import_set_state_nolock()) ffff92c1ff919000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790770382.181346:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1877758725604608:12345-0@lo:38: Request processed in 6048us (6135us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770382.181414:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1790770382.181532:0:7668:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff92c1cf1be300 x1877758725605120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770382.181543:0:7668:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca819f00 going to sleep for 0 seconds 00000040:00080000:1.0:1790770382.181762:0:7667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1790770382.182535:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1cf1bc700 x1877758725604608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790770392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770382.182547:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790770382.182557:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790770382.182566:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790770382.182576:0:3320:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790770382.182580:0:3320:0:(import.c:65:import_set_state_nolock()) ffff92c2009a9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790770382.182587:0:3320:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c69dacf): req@ffff92c1cf1be300 x1877758725605120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770382.182848:0:7668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.182890:0:7668:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca819f00 going to sleep for 11 seconds 00000020:01000000:0.0:1790770382.182917:0:7654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:2.0:1790770382.182923:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1877758725604608:0@lo:38: 10000000:01000000:0.0:1790770382.182981:0:7654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790770382.183003:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f44 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.183015:0:7654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1651800/0x7379b1d471b86f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f44 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790770382.183076:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790770382.183079:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790770382.183080:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790770382.183081:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790770382.183083:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790770382.183084:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790770382.183086:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790770382.183087:0:7654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790770382.183089:0:7654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790770382.183090:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790770382.183096:0:7654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790770382.183100:0:7654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790770382.183102:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790770382.183103:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790770382.183104:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790770382.183105:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790770382.183106:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790770382.183107:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790770382.183108:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790770382.183108:0:7654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790770382.183109:0:7654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790770382.183110:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790770382.183111:0:7654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790770382.183129:0:7654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790770382.183141:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725605248:0@lo:253: 00000100:00100000:0.0:1790770382.183192:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770382.183228:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c96526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770382.183245:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605248 00000100:00100000:1.0:1790770382.183253:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605248 00000100:00100000:1.0:1790770382.183307:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790770382.183316:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:7654:x1877758725605248:12345-0@lo:253: 20000000:01000000:1.0:1790770382.183356:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790770382.183373:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1790770382.184065:0:5869:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605120 00000100:00100000:3.0:1790770382.184073:0:5869:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605120 00000100:00100000:3.0:1790770382.184120:0:5869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790770382.184127:0:5869:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7668:x1877758725605120:12345-0@lo:901: 00000100:00100000:3.0:1790770382.185255:0:5869:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7668:x1877758725605120:12345-0@lo:901: Request processed in 1123us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.185265:0:5869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790770382.185517:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790770382.191966:0:7668:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92c1cf1be300 x1877758725605120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790770398 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770382.191988:0:7668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1be300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7668:1877758725605120:0@lo:901: 20000000:01000000:2.0:1790770382.231681:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790770382.231701:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790770382.232708:0:5874:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790770382.232715:0:5874:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790770382.232736:0:5874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.232754:0:5874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.232763:0:5874:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.232797:0:5874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770382.232811:0:5874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770382.232836:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725605376:0@lo:104: 00000100:00100000:3.0:1790770382.232898:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770382.232959:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c612d840 going to sleep for 11 seconds 00000100:00100000:0.0:1790770382.233058:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605376 00000100:00100000:0.0:1790770382.233066:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605376 00000100:00100000:0.0:1790770382.233112:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790770382.233120:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1eebaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725605376:12345-0@lo:104: 00010000:00010000:0.0:1790770382.233133:0:5841:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770382.233188:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790770382.233194:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1eebaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+3:5874:x1877758725605376:12345-0@lo:104: Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770382.233200:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1790770382.233259:0:5846:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790770382.233266:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.233273:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1401800 already unused, calling callback (ffffffffc1b18c20) 10000000:00010000:1.0:1790770382.233277:0:5846:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.233286:0:5846:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790770382.233307:0:5846:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770382.233313:0:5846:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790770382.233347:0:5846:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.233353:0:5846:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790770382.233367:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.233374:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.126@tcp lock: ffff92c1c1401800/0x7379b1d471b86eaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7379b1d471b86eb1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.233390:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770382.233391:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770382.233393:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770382.233835:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725605504:0@lo:103: 00000100:00100000:0.0:1790770382.233874:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770382.234039:0:5844:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605504 00000100:00100000:1.0:1790770382.234053:0:5844:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605504 00010000:00010000:1.0:1790770382.234073:0:5844:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 15 pid: 5853 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770382.234096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790770382.234102:0:5844:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:3322:x1877758725605504:12345-0@lo:103: 00010000:00010000:1.0:1790770382.234112:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790770382.234116:0:5844:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 15 pid: 5853 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234126:0:5844:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 15 pid: 5853 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234149:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234157:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790770382.234169:0:5844:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002344850s 00010000:00010000:1.0:1790770382.234173:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234180:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234187:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234194:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234199:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92c1c1400600 already unused, calling callback (ffffffffc14cbac0) 00010000:00010000:1.0:1790770382.234203:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234210:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234218:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770382.234226:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790770382.234252:0:5844:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:3322:x1877758725605504:12345-0@lo:103: Request processed in 150us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770382.234263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1790770382.234424:0:5874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1650600/0x7379b1d471b86eb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7379b1d471b86eaa expref: 14 pid: 5853 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770382.234437:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5874:1877758725605376:0@lo:104: 00010000:00010000:2.0:1790770382.234454:0:5874:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.234463:0:5874:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.234470:0:5874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770382.234476:0:5874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92c1c1400600/0x7379b1d471b86f60 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770382.234936:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3322:1877758725605504:0@lo:103: 00000100:00100000:3.0:1790770382.248181:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:7654:x1877758725605248:12345-0@lo:253: Request processed in 64856us (64978us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770382.248207:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790770382.248319:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:7654:1877758725605248:0@lo:253: 10000000:01000000:0.0:1790770382.248335:0:7654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790770382.248339:0:7654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790770382.248341:0:7654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790770382.248342:0:7654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790770382.248343:0:7654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790770382.248344:0:7654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790770382.248345:0:7654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790770382.248347:0:7654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790770382.248348:0:7654:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790770382.248349:0:7654:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790770382.248351:0:7654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790770382.248353:0:7654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790770382.248368:0:7654:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790770382.257606:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790770382.257781:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790770382.259105:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790770382.259286:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790770382.259489:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790770382.259729:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790770382.261591:0:7654:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1790770382.510897:0:7654:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1790770382.510906:0:7654:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1790770382.511073:0:7654:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790770382.511139:0:7654:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790770382.511156:0:7654:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790770382.511189:0:7654:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790770382.614182:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770383.642395:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770384.663300:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770385.686203:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790770386.266682:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790770386.266707:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725605632:0@lo:13: 00000100:00100000:1.0:1790770386.266770:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770386.268695:0:6717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605632 00000100:00100000:3.0:1790770386.268709:0:6717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605632 00000100:00100000:3.0:1790770386.268789:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790770386.268799:0:6717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725605632:12345-0@lo:13: 00000100:00080000:0.0:1790770386.268832:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790770386.268843:0:6717:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790770386.269014:0:6717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725605632:12345-0@lo:13: Request processed in 216us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770386.269022:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790770386.271525:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1cf1bf100 x1877758725605632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770386.271560:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725605632:0@lo:13: 00010000:00010000:0.0:1790770386.710395:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790770387.290334:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725605760:0@lo:400: 00000100:00100000:0.0:1790770387.290421:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770387.290492:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1877758725606272:0@lo:400: 00000100:00100000:0.0:1790770387.290525:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770387.290552:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790770387.290557:0:3324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725606144:0@lo:400: 00000100:00100000:0.0:1790770387.290580:0:3324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770387.290609:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725605888:0@lo:400: 00000100:00100000:2.0:1790770387.291055:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605760 00000100:00100000:2.0:1790770387.291064:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605760 00000100:00100000:2.0:1790770387.291115:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790770387.291126:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3324:x1877758725605760:12345-0@lo:400: 00000100:00100000:3.0:1790770387.293137:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606144 00000100:00100000:3.0:1790770387.293152:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606144 00000100:00100000:3.0:1790770387.293201:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790770387.293211:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725606144:12345-0@lo:400: 00000100:00100000:1.0:1790770387.293300:0:3322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1877758725606016:0@lo:400: 00000100:00100000:2.0:1790770387.293457:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:3324:x1877758725605760:12345-0@lo:400: Request processed in 2332us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770387.293484:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790770387.294267:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:3324:1877758725605760:0@lo:400: 00000100:00100000:2.0:1790770387.294305:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606272 00000100:00100000:2.0:1790770387.294310:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606272 00000100:00100000:2.0:1790770387.294366:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790770387.294373:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1877758725606272:12345-0@lo:400: 00000100:00100000:2.0:1790770387.294422:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1877758725606272:12345-0@lo:400: Request processed in 49us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770387.294429:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1790770387.294460:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1fb380700 x1877758725606272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770387.294473:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1877758725606272:0@lo:400: 00000100:00100000:0.0:1790770387.295078:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790770387.295113:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790770387.295126:0:7670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725605888 00000100:00100000:0.0:1790770387.295132:0:7670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725605888 00000100:00100000:0.0:1790770387.295164:0:7670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790770387.295172:0:7670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725605888:12345-0@lo:400: 00000100:00100000:0.0:1790770387.295214:0:7670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725605888:12345-0@lo:400: Request processed in 43us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770387.295221:0:7670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790770387.295249:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1fb381c00 x1877758725605888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770387.295261:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725605888:0@lo:400: 00000100:00100000:3.0:1790770387.296139:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1877758725606144:12345-0@lo:400: Request processed in 2926us (5553us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770387.296149:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790770387.296336:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1fb383800 x1877758725606144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770387.296349:0:3324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1877758725606144:0@lo:400: 00000100:00100000:1.0:1790770387.298090:0:3322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770387.298241:0:5858:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606016 00000100:00100000:3.0:1790770387.298250:0:5858:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606016 00000100:00100000:3.0:1790770387.298314:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790770387.298322:0:5858:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1877758725606016:12345-0@lo:400: 00000100:00100000:3.0:1790770387.298382:0:5858:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1877758725606016:12345-0@lo:400: Request processed in 61us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770387.298406:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790770387.299047:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790770387.299080:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1fb382680 x1877758725606016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770387.299095:0:3322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1877758725606016:0@lo:400: 00010000:00010000:1.0:1790770387.734250:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790770388.760325:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790770389.024454:0:8013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg426-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790770389.782266:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790770389.846151:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790770389.846159:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1c9563800 from 30 10000000:01000000:0.0:1790770389.846165:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790770389.846212:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.846242:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.846254:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770389.846277:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606400:0@lo:101: 00000100:00100000:0.0:1790770389.846348:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770389.846404:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ee2bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.846556:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606400 00000100:00100000:3.0:1790770389.846564:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606400 00000100:00100000:3.0:1790770389.846620:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790770389.846630:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+13:5855:x1877758725606400:12345-0@lo:101: 00010000:00010000:3.0:1790770389.846642:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770389.846655:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f67 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.846688:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f67 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.846699:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1400800/0x7379b1d471b86f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f67 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.846708:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1400800, rc 0) 00000100:00100000:3.0:1790770389.846760:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725606400:12345-0@lo:101: Request processed in 131us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.846766:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790770389.847002:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb383800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606400:0@lo:101: 00010000:00010000:1.0:1790770389.847019:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f6e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770389.847028:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f6e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770389.847082:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606528:0@lo:501: 00000100:00100000:1.0:1790770389.847114:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770389.847133:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c389bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.847268:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606528 00000100:00100000:3.0:1790770389.847273:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606528 00000100:00100000:3.0:1790770389.847302:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790770389.847308:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725606528:12345-0@lo:501: 00000100:00100000:3.0:1790770389.848551:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725606528:12345-0@lo:501: Request processed in 1237us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.848561:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790770389.848622:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606528:0@lo:501: 00000100:00100000:3.0:1790770389.849527:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606656:0@lo:503: 00000100:00100000:3.0:1790770389.849607:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.849651:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff835cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770389.850714:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606656 00000100:00100000:0.0:1790770389.850725:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606656 00000100:00100000:0.0:1790770389.850785:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790770389.850795:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725606656:12345-0@lo:503: 00000100:00100000:0.0:1790770389.851381:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725606656:12345-0@lo:503: Request processed in 586us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770389.851390:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790770389.851605:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725606656:0@lo:503: 00000100:00100000:3.0:1790770389.867276:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8048:1877758725606784:0@lo:502: 00000100:00100000:3.0:1790770389.867379:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.867481:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff8359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.869135:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606784 00000100:00100000:2.0:1790770389.869147:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606784 00000100:00100000:2.0:1790770389.869199:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790770389.869210:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:8048:x1877758725606784:12345-0@lo:502: 00000100:00100000:2.0:1790770389.869668:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:8048:x1877758725606784:12345-0@lo:502: Request processed in 459us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.869690:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790770389.873799:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8048:1877758725606784:0@lo:502: 00000100:00100000:2.0:1790770389.873920:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8048:1877758725606912:0@lo:502: 00000100:00100000:2.0:1790770389.874010:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.874059:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c4fa8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790770389.875756:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725606912 00000100:00100000:1.0:1790770389.875767:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725606912 00000100:00100000:1.0:1790770389.875971:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790770389.875983:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:8048:x1877758725606912:12345-0@lo:502: 00000100:00100000:1.0:1790770389.876272:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c537ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:8048:x1877758725606912:12345-0@lo:502: Request processed in 292us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770389.876280:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790770389.876528:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8048:1877758725606912:0@lo:502: 00000040:00080000:2.0:1790770389.876564:0:8048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790770389.878982:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790770389.879026:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790770389.879037:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f6e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770389.879050:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c2007eee00/0x7379b1d471b86f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f6e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790770389.879060:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790770389.879062:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1790770389.879065:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790770389.879097:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770389.879106:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770389.879117:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770389.879138:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607040:0@lo:101: 00000100:00100000:1.0:1790770389.879196:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770389.879793:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca139a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.881512:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607040 00000100:00100000:2.0:1790770389.881524:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607040 00000100:00100000:2.0:1790770389.881573:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790770389.881583:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+14:5855:x1877758725607040:12345-0@lo:101: 00010000:00010000:2.0:1790770389.881600:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790770389.881616:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86f7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f75 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.881641:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f75 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.881652:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c29b7e00/0x7379b1d471b86f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f75 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.881662:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c29b7e00, rc 0) 00000100:00100000:2.0:1790770389.881743:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607040:12345-0@lo:101: Request processed in 161us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.881750:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790770389.882159:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607040:0@lo:101: 00010000:00010000:1.0:1790770389.882188:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f7c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790770389.882196:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f7c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770389.882256:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607168:0@lo:501: 00000100:00100000:1.0:1790770389.882291:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770389.882327:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca139a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.882539:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607168 00000100:00100000:2.0:1790770389.882545:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607168 00000100:00100000:2.0:1790770389.882570:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790770389.882577:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607168:12345-0@lo:501: 00000100:00100000:2.0:1790770389.884160:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607168:12345-0@lo:501: Request processed in 1579us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.884171:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790770389.885014:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607168:0@lo:501: 00000100:00100000:1.0:1790770389.885064:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607296:0@lo:503: 00000100:00100000:1.0:1790770389.885116:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770389.885150:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca139a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.886153:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607296 00000100:00100000:2.0:1790770389.886171:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607296 00000100:00100000:2.0:1790770389.886214:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790770389.886222:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607296:12345-0@lo:503: 00000100:00100000:2.0:1790770389.890098:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607296:12345-0@lo:503: Request processed in 3868us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.890113:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790770389.890675:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607296:0@lo:503: 00000100:00100000:3.0:1790770389.891211:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8051:1877758725607424:0@lo:502: 00000100:00100000:3.0:1790770389.891261:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.891293:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86780 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.891357:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607424 00000100:00100000:2.0:1790770389.891364:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607424 00000100:00100000:2.0:1790770389.891412:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790770389.891421:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:8051:x1877758725607424:12345-0@lo:502: 00000100:00100000:2.0:1790770389.892333:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:8051:x1877758725607424:12345-0@lo:502: Request processed in 909us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.892342:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790770389.897330:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8051:1877758725607424:0@lo:502: 00000020:01000000:3.0:1790770389.897397:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790770389.897412:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770389.897414:0:8051:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790770389.897426:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790770389.897429:0:8051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790770389.898178:0:8051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8051:1877758725607552:0@lo:502: 00000100:00100000:3.0:1790770389.898250:0:8051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.898336:0:8051:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86780 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.900021:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607552 00000100:00100000:2.0:1790770389.900038:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607552 00000100:00100000:2.0:1790770389.900103:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790770389.900114:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:8051:x1877758725607552:12345-0@lo:502: 00000100:00100000:2.0:1790770389.900656:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:8051:x1877758725607552:12345-0@lo:502: Request processed in 541us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.900664:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790770389.900723:0:8051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8051:1877758725607552:0@lo:502: 00000020:01000000:3.0:1790770389.900765:0:8051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790770389.900773:0:8051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790770389.900776:0:8051:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790770389.900787:0:8051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1790770389.901553:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1790770389.901575:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790770389.901585:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f7c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.901597:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1650600/0x7379b1d471b86f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f7c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770389.901623:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790770389.901626:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92c1c64e1000 from 30 10000000:01000000:2.0:1790770389.901629:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790770389.901660:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.901667:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.901690:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770389.901710:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607680:0@lo:101: 00000100:00100000:2.0:1790770389.901753:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.901795:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff8359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790770389.901853:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607680 00000100:00100000:0.0:1790770389.901860:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607680 00000100:00100000:0.0:1790770389.901912:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790770389.901921:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+15:5855:x1877758725607680:12345-0@lo:101: 00010000:00010000:0.0:1790770389.901932:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790770389.901975:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c2007ef000/0x7379b1d471b86f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.901998:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c2007ef000/0x7379b1d471b86f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f83 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.902008:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c2007ef000/0x7379b1d471b86f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f83 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.902024:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c2007ef000, rc 0) 00000100:00100000:0.0:1790770389.902065:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725607680:12345-0@lo:101: Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770389.902071:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790770389.902574:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607680:0@lo:101: 00010000:00010000:3.0:1790770389.902595:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f8a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.902604:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f8a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770389.902655:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607808:0@lo:501: 00000100:00100000:3.0:1790770389.902700:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.902731:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86780 going to sleep for 11 seconds 00000100:00100000:0.0:1790770389.903536:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607808 00000100:00100000:0.0:1790770389.903543:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607808 00000100:00100000:0.0:1790770389.903588:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790770389.903597:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725607808:12345-0@lo:501: 00000100:00100000:0.0:1790770389.904148:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725607808:12345-0@lo:501: Request processed in 552us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770389.904156:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790770389.904448:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607808:0@lo:501: 00000100:00100000:3.0:1790770389.904491:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607936:0@lo:503: 00000100:00100000:3.0:1790770389.904537:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.904572:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86780 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.904688:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725607936 00000100:00100000:2.0:1790770389.904694:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725607936 00000100:00100000:2.0:1790770389.904728:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790770389.904734:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725607936:12345-0@lo:503: 00000100:00100000:2.0:1790770389.904916:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725607936:12345-0@lo:503: Request processed in 182us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.904923:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790770389.905298:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725607936:0@lo:503: 00000100:00100000:3.0:1790770389.907799:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8053:1877758725608064:0@lo:502: 00000100:00100000:3.0:1790770389.907905:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.907962:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2f86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790770389.910081:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608064 00000100:00100000:0.0:1790770389.910097:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608064 00000100:00100000:0.0:1790770389.910155:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790770389.910164:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:8053:x1877758725608064:12345-0@lo:502: 00000100:00100000:0.0:1790770389.910461:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:8053:x1877758725608064:12345-0@lo:502: Request processed in 297us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790770389.910469:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790770389.910779:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8053:1877758725608064:0@lo:502: 00000100:00100000:3.0:1790770389.910848:0:8053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8053:1877758725608192:0@lo:502: 00000100:00100000:3.0:1790770389.910908:0:8053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.910964:0:8053:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2bd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.911033:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608192 00000100:00100000:2.0:1790770389.911038:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608192 00000100:00100000:2.0:1790770389.911073:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790770389.911081:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:8053:x1877758725608192:12345-0@lo:502: 00000100:00100000:2.0:1790770389.911242:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:8053:x1877758725608192:12345-0@lo:502: Request processed in 162us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.911255:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790770389.911327:0:8053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8053:1877758725608192:0@lo:502: 00000040:00080000:3.0:1790770389.911348:0:8053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1790770389.911690:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1790770389.911708:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790770389.911718:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f8a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.911730:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c29b7600/0x7379b1d471b86f83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f8a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790770389.911739:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790770389.911741:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92c1c64e1000 from 5 10000000:01000000:2.0:1790770389.911744:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790770389.911769:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.911777:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.911786:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770389.911798:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608320:0@lo:101: 00000100:00100000:2.0:1790770389.911839:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.911868:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c9409900 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.911920:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608320 00000100:00100000:3.0:1790770389.911924:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608320 00000100:00100000:3.0:1790770389.911991:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790770389.912000:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+16:5855:x1877758725608320:12345-0@lo:101: 00010000:00010000:3.0:1790770389.912009:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770389.912022:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1401c00/0x7379b1d471b86f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f91 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.912041:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1401c00/0x7379b1d471b86f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f91 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.912051:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1401c00/0x7379b1d471b86f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f91 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.912059:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1401c00, rc 0) 00000100:00100000:3.0:1790770389.912090:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0028c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+17:5855:x1877758725608320:12345-0@lo:101: Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.912096:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790770389.912261:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608320:0@lo:101: 00010000:00010000:2.0:1790770389.912272:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f98 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790770389.912280:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86f98 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790770389.912323:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608448:0@lo:256: 00000100:00100000:2.0:1790770389.912349:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.912376:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c9409900 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.912619:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608448 00000100:00100000:3.0:1790770389.912624:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608448 00000100:00100000:3.0:1790770389.912654:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790770389.912660:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+17:5855:x1877758725608448:12345-0@lo:256: 20000000:01000000:3.0:1790770389.912683:0:5851:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790770389.912701:0:5851:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790770389.912704:0:5851:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1790770389.912788:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+17:5855:x1877758725608448:12345-0@lo:256: Request processed in 128us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.912795:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790770389.915166:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608448:0@lo:256: 10000000:01000000:0.0:1790770389.915243:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790770389.915253:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f98 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.915265:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c29b6000/0x7379b1d471b86f91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86f98 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790770389.915287:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790770389.915289:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1790770389.915292:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790770389.915325:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.915333:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790770389.915341:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790770389.915359:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608576:0@lo:101: 00000100:00100000:0.0:1790770389.915419:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770389.915466:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c9409900 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.915521:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608576 00000100:00100000:3.0:1790770389.915528:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608576 00000100:00100000:3.0:1790770389.915573:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790770389.915590:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+17:5855:x1877758725608576:12345-0@lo:101: 00010000:00010000:3.0:1790770389.915603:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770389.915614:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1401400/0x7379b1d471b86fa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86f9f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.915637:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1401400/0x7379b1d471b86fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86f9f expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.915659:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1401400/0x7379b1d471b86fa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86f9f expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.915667:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1401400, rc 0) 00000100:00100000:3.0:1790770389.915720:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725608576:12345-0@lo:101: Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.915726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790770389.915767:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608576:0@lo:101: 00010000:00010000:3.0:1790770389.915779:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fa6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.915788:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86fa6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770389.915846:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608704:0@lo:501: 00000100:00100000:3.0:1790770389.915872:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.915891:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608704 00000100:00100000:3.0:1790770389.915906:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608704 00000100:00100000:3.0:1790770389.915923:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790770389.915928:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725608704:12345-0@lo:501: 00000100:00100000:3.0:1790770389.916193:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725608704:12345-0@lo:501: Request processed in 263us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.916199:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790770389.916220:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c699e540 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.916231:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608704:0@lo:501: 00000100:00100000:3.0:1790770389.916257:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608832:0@lo:503: 00000100:00100000:3.0:1790770389.916292:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.916310:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608832 00000100:00100000:3.0:1790770389.916313:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608832 00000100:00100000:3.0:1790770389.916328:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790770389.916334:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d0029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725608832:12345-0@lo:503: 00000100:00100000:3.0:1790770389.916598:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d0029850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725608832:12345-0@lo:503: Request processed in 263us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.916605:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790770389.916634:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c699e540 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.916646:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725608832:0@lo:503: 00000100:00100000:2.0:1790770389.919782:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8054:1877758725608960:0@lo:502: 00000100:00100000:2.0:1790770389.920018:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.920092:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff92e540 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.923822:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725608960 00000100:00100000:3.0:1790770389.925101:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725608960 00000100:00100000:3.0:1790770389.925171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790770389.925187:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1d002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:8054:x1877758725608960:12345-0@lo:502: 00000100:00100000:3.0:1790770389.926114:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1d002a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:8054:x1877758725608960:12345-0@lo:502: Request processed in 931us (6170us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.926125:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790770389.937224:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8054:1877758725608960:0@lo:502: 00000020:01000000:2.0:1790770389.937272:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790770389.937280:0:8054:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790770389.937288:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770389.937290:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790770389.937295:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790770389.937300:0:8054:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.126@tcp to nid 0x20000c0a8cc7e (192.168.204.126@tcp) 00000020:01000000:2.0:1790770389.937324:0:8054:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790770389.937327:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790770389.937342:0:8054:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92c1f63e4d40) 00000020:00000080:2.0:1790770389.937366:0:8054:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790770389.937372:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790770389.937480:0:8054:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790770389.937487:0:8054:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790770389.937494:0:8054:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7379b1d471b86fb4 00010000:00080000:2.0:1790770389.937521:0:8054:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92c1c8447000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.126@tcp at head 00010000:00010000:2.0:1790770389.937756:0:8054:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790770389.939997:0:8054:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790770389.940014:0:8054:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790770389.940972:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790770389.941208:0:8054:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790770389.941268:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790770389.941329:0:8054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790770389.943792:0:8057:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790770389.943799:0:8057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790770389.944826:0:8054:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790770389.945114:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790770389.945148:0:8054:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790770389.945168:0:8054:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7379b1d471b86fbb 00000100:00080000:2.0:1790770389.945178:0:8054:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790770389.945188:0:8054:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92c1c8447000 using connection 192.168.204.126@tcp/0@lo 00000100:00100000:2.0:1790770389.945222:0:8054:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92c1f638f100 x1877758725609088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790770389.945281:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1877758725609088:0@lo:8: 00000100:00100000:0.0:1790770389.945343:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770389.945447:0:6713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609088 00000100:00100000:1.0:1790770389.945456:0:6713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609088 00000100:00100000:1.0:1790770389.945490:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790770389.945496:0:6713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1877758725609088:12345-0@lo:8: 00010000:00080000:1.0:1790770389.945520:0:6713:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:1.0:1790770389.945544:0:6713:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7379b1d471b86fc2 00002000:00100000:1.0:1790770389.945558:0:6713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92c1ff753000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790770389.945562:0:6713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1790770389.945565:0:6713:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790770389.945689:0:6713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790770389.945876:0:6713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790770389.945908:0:6713:0:(import.c:65:import_set_state_nolock()) ffff92c1ff754800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1790770389.946213:0:8054:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1790770389.946438:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725609216:0@lo:400: 00000100:00100000:2.0:1790770389.946475:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.946501:0:7670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609216 00000100:00100000:2.0:1790770389.946504:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790770389.946507:0:7670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609216 00000100:00100000:2.0:1790770389.946509:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1877758725609344:0@lo:400: 00000100:00100000:2.0:1790770389.946531:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.946556:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725609472:0@lo:400: 00000100:00100000:2.0:1790770389.946592:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.946615:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790770389.946621:0:3323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1877758725609600:0@lo:400: 00000100:00100000:2.0:1790770389.946643:0:3323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.946684:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609344 00000100:00100000:2.0:1790770389.946688:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609344 00000100:00100000:2.0:1790770389.946731:0:5859:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609600 00000100:00100000:2.0:1790770389.946734:0:5859:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609600 00000100:00100000:2.0:1790770389.946749:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790770389.946764:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1877758725609344:12345-0@lo:400: 00000100:00100000:2.0:1790770389.946810:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1877758725609344:12345-0@lo:400: Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.946817:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790770389.946976:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790770389.946984:0:5859:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1877758725609600:12345-0@lo:400: 00000100:00100000:2.0:1790770389.947017:0:5859:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1877758725609600:12345-0@lo:400: Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.947023:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1790770389.947037:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790770389.947059:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1f638c380 x1877758725609344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770389.947071:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1877758725609344:0@lo:400: 00010000:00080000:2.0:1790770389.947096:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1f638e680 x1877758725609600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770389.947105:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1877758725609600:0@lo:400: 00000100:00100000:3.0:1790770389.947108:0:7670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790770389.947120:0:7670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1f638f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725609216:12345-0@lo:400: 00000020:01000000:2.0:1790770389.947159:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790770389.947165:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770389.947167:0:8054:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790770389.947171:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790770389.947174:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770389.947175:0:8054:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790770389.947178:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790770389.947180:0:8054:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790770389.947202:0:8054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ca31b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8054:1877758725609728:0@lo:502: 00000100:00100000:2.0:1790770389.947239:0:8054:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770389.947260:0:5851:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609728 00000100:00100000:2.0:1790770389.947270:0:5851:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609728 00000100:00100000:2.0:1790770389.947292:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790770389.947298:0:5851:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:8054:x1877758725609728:12345-0@lo:502: 00000100:00100000:3.0:1790770389.947361:0:7670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1f638f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1877758725609216:12345-0@lo:400: Request processed in 241us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.947367:0:7670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790770389.947502:0:5851:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:8054:x1877758725609728:12345-0@lo:502: Request processed in 204us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.947509:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790770389.947552:0:8054:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff92ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790770389.947564:0:8054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ca31b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:8054:1877758725609728:0@lo:502: 00000020:01000000:2.0:1790770389.947585:0:8054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790770389.947589:0:8054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790770389.947590:0:8054:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790770389.947593:0:8054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1790770389.948043:0:6715:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790770389.948051:0:6715:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1790770389.948126:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609472 00000100:00100000:2.0:1790770389.948131:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609472 00000100:00100000:2.0:1790770389.948156:0:6715:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790770389.948164:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790770389.948171:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725609472:12345-0@lo:400: 00000100:00100000:2.0:1790770389.948210:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1877758725609472:12345-0@lo:400: Request processed in 40us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770389.948216:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1790770389.948231:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790770389.948250:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1f638c000 x1877758725609472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790770405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770389.948260:0:3323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1877758725609472:0@lo:400: 00010000:00080000:3.0:1790770389.948366:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1f638c700 x1877758725609216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790770405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770389.948386:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1877758725609216:0@lo:400: 00000020:01000000:3.0:1790770389.948404:0:5855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790770389.948429:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790770389.948440:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fa6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948450:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c2007ee600/0x7379b1d471b86f9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fa6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790770389.948461:0:5855:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790770389.948463:0:5855:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92c1e2b94d40 from 1 10000000:01000000:3.0:1790770389.948466:0:5855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790770389.948492:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948500:0:5855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948650:0:5855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770389.948667:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725609856:0@lo:101: 00000100:00100000:3.0:1790770389.948706:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.948725:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca543240 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.948740:0:5853:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609856 00000100:00100000:3.0:1790770389.948743:0:5853:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609856 00000100:00100000:3.0:1790770389.948772:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790770389.948778:0:5853:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+18:5855:x1877758725609856:12345-0@lo:101: 00010000:00010000:3.0:1790770389.948788:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790770389.948801:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92c1c1401000/0x7379b1d471b86fd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7379b1d471b86fc9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948838:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92c1c1401000/0x7379b1d471b86fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7379b1d471b86fc9 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948849:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92c1c1401000/0x7379b1d471b86fd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7379b1d471b86fc9 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.948857:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92c1c1401000, rc 0) 00000100:00100000:3.0:1790770389.948887:0:5853:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+19:5855:x1877758725609856:12345-0@lo:101: Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770389.949001:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790770389.949034:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725609856:0@lo:101: 00010000:00010000:3.0:1790770389.949048:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fd0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.949055:0:5855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7379b1d471b86fd0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790770389.949095:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725609984:0@lo:501: 00000100:00100000:3.0:1790770389.949130:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790770389.949146:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ca543240 going to sleep for 11 seconds 00000100:00100000:3.0:1790770389.949158:0:5852:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725609984 00000100:00100000:3.0:1790770389.949162:0:5852:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725609984 00000100:00100000:3.0:1790770389.949181:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790770389.949186:0:5852:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1c8933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+19:5855:x1877758725609984:12345-0@lo:501: 00000100:00100000:3.0:1790770389.949405:0:5852:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1c8933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3+19:5855:x1877758725609984:12345-0@lo:501: Request processed in 218us (273us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790770389.949412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790770389.949440:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1eeba8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8b7ed20-66af-4ab8-b4a9-a37edc4feaf3:5855:1877758725609984:0@lo:501: 10000000:01000000:3.0:1790770389.949458:0:5855:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790770389.949463:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fd0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790770389.949470:0:5855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.126@tcp lock: ffff92c1c1401e00/0x7379b1d471b86fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7379b1d471b86fd0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790770389.953639:0:6713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1877758725609088:12345-0@lo:8: Request processed in 8131us (8284us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770389.953669:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1790770389.954149:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1f638f100 x1877758725609088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790770399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770389.954162:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790770389.954171:0:3320:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790770389.954179:0:3320:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790770389.954185:0:3320:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1790770389.954188:0:3320:0:(import.c:65:import_set_state_nolock()) ffff92c1c8447000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790770389.954248:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790770389.954255:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1f638f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1877758725609088:0@lo:8: 00000004:00080000:3.0:1790770389.954785:0:8057:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790770389.954927:0:8057:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 248907984880ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790770390.035373:0:5880:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790770390.103314:0:8058:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790770390.103361:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ca319c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610240:0@lo:7: 00000100:00100000:2.0:1790770390.103511:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770390.103562:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff92e240 going to sleep for 11 seconds 00000100:00100000:2.0:1790770390.103594:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ca31b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725610112:0@lo:13: 00000100:00100000:2.0:1790770390.103622:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770390.103661:0:6715:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610240 00000100:00100000:2.0:1790770390.103669:0:6715:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610240 00000100:00100000:2.0:1790770390.103730:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790770390.103739:0:6715:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8058:x1877758725610240:12345-0@lo:7: 00000100:00100000:1.0:1790770390.107096:0:6717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610112 00000100:00100000:1.0:1790770390.107111:0:6717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610112 00000100:00100000:1.0:1790770390.107174:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790770390.107185:0:6717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca31b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1877758725610112:12345-0@lo:13: 00002000:00000024:1.0:1790770390.107217:0:6717:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790770390.107297:0:6717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca31b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1877758725610112:12345-0@lo:13: Request processed in 114us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770390.107305:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790770390.107368:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1ca31b800 x1877758725610112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770390.107389:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ca31b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725610112:0@lo:13: 00000100:00080000:3.0:1790770390.108001:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1790770390.121330:0:6715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790770390.121341:0:6715:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790770390.125413:0:6715:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca31aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8058:x1877758725610240:12345-0@lo:7: Request processed in 21664us (21891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790770390.125430:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790770390.128933:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1ca319c00 x1877758725610240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790770406 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790770390.129025:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ca319c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610240:0@lo:7: 00000004:00080000:1.0:1790770390.129041:0:8058:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1790770390.129081:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610368:0@lo:5: 00000100:00100000:1.0:1790770390.129135:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770390.129228:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1e2aeec00 going to sleep for 11 seconds 00000100:00100000:2.0:1790770390.133793:0:6713:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610368 00000100:00100000:2.0:1790770390.133809:0:6713:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610368 00000100:00100000:1.0:1790770390.137567:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790770390.137584:0:6713:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1cf1be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8058:x1877758725610368:12345-0@lo:5: 00002000:00080000:1.0:1790770390.137621:0:6713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790770390.137625:0:6713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790770390.138041:0:6713:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1cf1be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8058:x1877758725610368:12345-0@lo:5: Request processed in 461us (8904us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790770390.138060:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1790770390.138494:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1cf1bfb80 x1877758725610368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790770406 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790770390.138585:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610368:0@lo:5: 00000004:00080000:0.0:1790770390.138600:0:8058:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790770390.138642:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610496:0@lo:700: 00000100:00100000:0.0:1790770390.138684:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790770390.138726:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1c2bdc840 going to sleep for 11 seconds 00000100:00100000:2.0:1790770390.138777:0:6721:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610496 00000100:00100000:2.0:1790770390.138784:0:6721:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610496 00000100:00100000:2.0:1790770390.139118:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790770390.139129:0:6721:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1fb382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8058:x1877758725610496:12345-0@lo:700: 00000100:00100000:2.0:1790770390.139168:0:6721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ca319500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6721:1877758725610624:0@lo:700: 00000100:00100000:2.0:1790770390.139205:0:6721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770390.139225:0:6721:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff92e180 going to sleep for 11 seconds 00000100:00100000:2.0:1790770390.139239:0:5865:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610624 00000100:00100000:2.0:1790770390.139243:0:5865:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610624 00000100:00100000:2.0:1790770390.139271:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790770390.139277:0:5865:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6721:x1877758725610624:12345-0@lo:700: 40000000:02000000:2.0:1790770390.210653:0:5865:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1790770390.222353:0:5865:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6721:x1877758725610624:12345-0@lo:700: Request processed in 83066us (83137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790770390.222369:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790770390.222493:0:6721:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1ca319500 x1877758725610624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790770406 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770390.224631:0:6721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ca319500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6721:1877758725610624:0@lo:700: 40000000:02000000:2.0:1790770390.224653:0:6721:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1790770390.350442:0:7672:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1790770390.350456:0:7672:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790770390.350568:0:6721:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1fb382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8058:x1877758725610496:12345-0@lo:700: Request processed in 211437us (211879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770390.350586:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790770390.350996:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1fb381180 x1877758725610496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790770406 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770390.351016:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1fb381180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610496:0@lo:700: 00000004:02000040:3.0:1790770390.417396:0:8058:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1790770390.427371:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1ca319500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610752:0@lo:5: 00000100:00100000:2.0:1790770390.427442:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790770390.427494:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff92c1ff92eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790770390.427661:0:8060:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610752 00000100:00100000:3.0:1790770390.427679:0:8060:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610752 00000100:00100000:3.0:1790770390.427734:0:8060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790770390.427744:0:8060:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1ca31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8058:x1877758725610752:12345-0@lo:5: 00002000:00080000:0.0:1790770390.434822:0:8060:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790770390.434842:0:8060:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1790770390.438650:0:8060:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1ca31bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8058:x1877758725610752:12345-0@lo:5: Request processed in 10901us (11200us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790770390.438675:0:8060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1790770390.438814:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1ca319500 x1877758725610752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790770406 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770390.438829:0:8058:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790770390.438844:0:8058:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff92c1ca319500 x1877758725610752/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790770406 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790770390.438856:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1ca319500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1877758725610752:0@lo:5: 00000004:00080000:2.0:1790770390.438870:0:8058:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790770390.808096:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790770391.382548:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790770391.382573:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725610880:0@lo:13: 00000100:00100000:3.0:1790770391.382642:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790770391.382826:0:6717:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877758725610880 00000100:00100000:1.0:1790770391.382834:0:6717:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877758725610880 00000100:00100000:1.0:1790770391.382906:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790770391.382915:0:6717:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff92c1eeba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1877758725610880:12345-0@lo:13: 00002000:00000024:1.0:1790770391.382971:0:6717:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790770391.383034:0:6717:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff92c1eeba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1877758725610880:12345-0@lo:13: Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790770391.383042:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790770391.383719:0:5854:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790770391.383754:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92c1cf1bf100 x1877758725610880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790770407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790770391.383776:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff92c1cf1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1877758725610880:0@lo:13: 00010000:00010000:1.0:1790770391.832688:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790770392.864308:0:5847:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790770393.878442:0:5846:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 4213 lines, 4213 kept, 0 dropped, 0 bad.