00000001:02000400:3.0F:1789760655.697488:0:3103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789760665.492475:0:3305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789760667.181966:0:3349:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 764 MB/s 00000001:01000000:0.0F:1789760667.431790:0:3349:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 595 MB/s 00000001:01000000:1.0F:1789760667.681230:0:3349:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4051 MB/s 00000020:02000000:2.0:1789760668.585847:0:3397:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g4c74034 00000400:02000000:1.0:1789760669.448072:0:3412:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.153@tcp [8/256/0/180] 00008000:02000000:0.0:1789760673.305544:0:3562:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789760734.064741:0:5826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789760741.647227:0:6411:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789760741.647233:0:6411:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789760741.647386:0:6411:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008138c30e 00000080:02000400:1.0:1789760741.647396:0:6411:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789760741.651176:0:6411:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789760741.651216:0:6411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789760741.651256:0:6411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004e995943) 00000020:00000080:1.0:1789760741.651275:0:6411:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789760741.663371:0:6411:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789760741.663737:0:6411:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789760741.681393:0:6411:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789760741.681437:0:6411:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789760741.681462:0:6411:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789760741.681518:0:6411:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789760741.681546:0:6411:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789760741.682084:0:6411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789760741.682093:0:6411:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760741.682102:0:6411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b71c0 00000020:01000004:1.0:1789760741.682110:0:6411:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789760741.682116:0:6411:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789760741.682120:0:6411:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008138c30e from MGS 00000020:01000004:1.0:1789760741.682125:0:6411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789760741.682135:0:6411:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000092b5ff1b) 00000020:00000080:1.0:1789760741.682145:0:6411:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789760741.682233:0:6411:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008138c30e from MGS, refs=2 00080000:01000000:1.0:1789760741.682239:0:6411:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789760741.682244:0:6411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b71ce 00000100:00100000:1.0:1789760741.682348:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789760741.682503:0:6411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789760741.682516:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789760741.683054:0:6411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789760741.683061:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789760741.683824:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760741.683993:0:6411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789760741.684000:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789760741.684507:0:6411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789760741.684513:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789760741.684875:0:6411:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789760741.684880:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789760741.685541:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760741.685545:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760741.685547:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760741.685838:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760741.685840:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760741.685842:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760741.686376:0:6411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789760741.690057:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789760741.936616:0:6411:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3851 MB/s 00000001:01000000:0.0:1789760742.186355:0:6411:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4419 MB/s 00000001:01000000:2.0:1789760742.437784:0:6411:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 645 MB/s 00000001:01000000:3.0:1789760742.687422:0:6411:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 819 MB/s 00080000:10000000:3.0:1789760742.693694:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789760742.708892:0:6411:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789760742.708909:0:6411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760742.708912:0:6411:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789760742.709605:0:6421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789760742.709688:0:6411:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789760742.709720:0:6411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789760742.709880:0:6411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789760742.709903:0:6411:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789760742.710643:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760742.710808:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789760742.710815:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789760742.711731:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789760742.711739:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789760742.712304:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789760742.712312:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789760742.714669:0:6411:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789760742.714692:0:6411:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.153@tcp' 00000020:01000004:0.0:1789760742.714695:0:6411:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789760742.714749:0:6411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.153@tcp (typ=mgc) 00000020:00000080:0.0:1789760742.714768:0:6411:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.153@tcp (00000000b8a2edeb) 00000020:00000080:0.0:1789760742.714786:0:6411:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789760742.714923:0:6411:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bff02538@MGC192.168.203.153@tcp: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1789760742.715080:0:6411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.153@tcp-0 is initialized 00000040:01000000:0.0:1789760742.715086:0:6411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789760742.715308:0:6426:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789760742.717677:0:6427:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789760742.718419:0:6411:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.153@tcp (uuid 751d7670-4ea9-4485-a191-8db5c056760e) 00000020:00000080:1.0:1789760742.718455:0:6411:0:(genops.c:1385:class_connect()) connect: client 751d7670-4ea9-4485-a191-8db5c056760e, cookie 0x838c7b3c022b71dc 00000100:00080000:1.0:1789760742.718469:0:6411:0:(import.c:510:import_select_connection()) MGC192.168.203.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760742.718476:0:6411:0:(import.c:624:import_select_connection()) MGC192.168.203.153@tcp: import 00000000bff02538 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1789760742.718532:0:6411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001d46f859 x1876700083257472/t0(0) o250->MGC192.168.203.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789760742.718700:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001d46f859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:751d7670-4ea9-4485-a191-8db5c056760e:3427:1876700083257472:0@lo:250: 00000100:00100000:2.0:1789760742.718792:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760742.719085:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083257472 00000100:00100000:0.0:1789760742.719096:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083257472 00000100:00100000:0.0:1789760742.719130:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760742.719138:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdaffb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3427:x1876700083257472:12345-0@lo:250: 00010000:00080000:0.0:1789760742.719163:0:6422:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 751d7670-4ea9-4485-a191-8db5c056760e@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:0.0:1789760742.719205:0:6422:0:(genops.c:1385:class_connect()) connect: client 751d7670-4ea9-4485-a191-8db5c056760e, cookie 0x838c7b3c022b71e3 00000100:00080000:1.0:1789760742.719253:0:6411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 751d7670-4ea9-4485-a191-8db5c056760e->MGS 00000020:01000004:1.0:1789760742.719269:0:6411:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789760742.719275:0:6411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789760742.719286:0:6411:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000006910a) 00000020:00000080:1.0:1789760742.719298:0:6411:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1789760742.719332:0:6422:0:(import.c:65:import_set_state_nolock()) 0000000094612dcd : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760742.719459:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdaffb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+5:3427:x1876700083257472:12345-0@lo:250: Request processed in 319us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760742.719467:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760742.720448:0:3427:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789760742.720460:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.153@tcp: connect to target with instance 0 00000100:00080000:2.0:1789760742.720467:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789760742.720472:0:3427:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789760742.720476:0:3427:0:(import.c:65:import_set_state_nolock()) 00000000bff02538 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789760742.720479:0:3427:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789760742.720573:0:3427:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789760742.720581:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001d46f859 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:751d7670-4ea9-4485-a191-8db5c056760e:3427:1876700083257472:0@lo:250: 00010000:00010000:0.0:1789760742.726327:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760742.730900:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760742.731221:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789760742.731228:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789760742.732767:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789760742.732778:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789760742.733553:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789760742.733562:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789760742.734424:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760742.735462:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789760742.735471:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789760742.736667:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789760742.736678:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789760742.773717:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760742.773939:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789760742.773946:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789760742.775379:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789760742.775392:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789760742.776439:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760742.776654:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789760742.776661:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789760742.777124:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789760742.777132:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789760742.778850:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789760742.779087:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789760742.779094:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789760742.779918:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789760742.779927:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789760742.787407:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789760742.788702:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789760742.788710:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789760742.791480:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789760742.791498:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789760742.810401:0:6411:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760742.810685:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789760742.810692:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789760742.811770:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789760742.811780:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789760742.813580:0:6411:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789760742.813594:0:6411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789760742.814328:0:6411:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789760742.814352:0:6411:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789760742.814359:0:6411:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789760742.814570:0:6411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789760742.814607:0:6411:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789760742.814612:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789760742.814614:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789760742.814615:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760742.814616:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760742.814618:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760742.814619:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760742.814625:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760742.814627:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789760742.814628:0:6411:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760742.814629:0:6411:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760742.814630:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760742.814632:0:6411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760742.814634:0:6411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789760742.814636:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760742.814637:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789760742.814638:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760742.814639:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760742.814640:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760742.814641:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760742.814642:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760742.814643:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789760742.814643:0:6411:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760742.814644:0:6411:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760742.814645:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760742.814646:0:6411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760742.814684:0:6411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789760742.814702:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2146824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257600:0@lo:253: 00000100:00100000:2.0:1789760742.814775:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760742.814873:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5bbbd09 going to sleep for 11 seconds 00000100:00100000:3.0:1789760742.814927:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083257600 00000100:00100000:3.0:1789760742.814937:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083257600 00000100:00100000:3.0:1789760742.815052:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760742.815062:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000523bec0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+5:6411:x1876700083257600:12345-0@lo:253: 20000000:01000000:3.0:1789760742.815112:0:6425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789760742.815115:0:6425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789760742.815537:0:6445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789760742.815596:0:6425:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789760742.815875:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760742.817354:0:6446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789760742.817623:0:6425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789760742.817627:0:6425:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789760742.817632:0:6425:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789760742.817635:0:6425:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789760742.817650:0:6425:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789760742.817888:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760742.818138:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789760742.818152:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760742.818257:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789760742.818310:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789760742.818349:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789760742.818785:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789760742.818796:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789760742.818847:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789760742.818856:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789760742.818890:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789760742.818897:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789760742.818927:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789760742.819006:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789760742.819041:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789760742.819045:0:6425:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789760742.819056:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760742.819383:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789760742.819394:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760742.819499:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789760742.819533:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789760742.819583:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789760742.819594:0:6425:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789760742.819661:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789760742.819669:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760742.819729:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789760742.819768:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789760742.819802:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789760742.819814:0:6425:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789760742.819899:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789760742.819909:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789760742.819942:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789760742.819991:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789760742.820143:0:6425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789760742.820412:0:6425:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789760742.820532:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789760742.820968:0:6447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789760742.821316:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789760742.821338:0:6425:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.153@tcp for mdt 20000000:01000000:1.0:1789760742.821340:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789760742.821375:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789760742.821381:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789760742.821406:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789760742.821482:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1789760742.821530:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789760742.821539:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789760742.822313:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789760742.822357:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789760742.823726:0:6425:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760742.823732:0:6425:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789760742.823736:0:6425:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789760742.823743:0:6425:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789760742.824217:0:6448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1789760742.824349:0:6425:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789760742.832639:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789760742.832694:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789760742.832772:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789760742.832790:0:6425:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760742.832793:0:6425:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760742.832796:0:6425:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760742.832808:0:6425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760742.832811:0:6425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789760742.832840:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789760742.832842:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789760742.833778:0:6449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789760742.834092:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789760742.834134:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789760742.834167:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789760742.834241:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789760742.834244:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789760742.834903:0:6450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789760742.835153:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789760742.835479:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789760742.835548:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1789760742.835562:0:6425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760742.835565:0:6425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789760742.835572:0:6425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789760742.835594:0:6425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835614:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835626:0:6425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835633:0:6425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835650:0:6425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835657:0:6425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835664:0:6425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066dcc7a2 already unused, calling callback (00000000d208beed) 00010000:00010000:3.0:1789760742.835668:0:6425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835677:0:6425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835692:0:6425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835699:0:6425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760742.835705:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000066dcc7a2/0x838c7b3c022b71f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789760742.835722:0:6425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789760743.004541:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000523bec0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+5:6411:x1876700083257600:12345-0@lo:253: Request processed in 189474us (189760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.004561:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760743.004668:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2146824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257600:0@lo:253: 10000000:01000000:2.0:1789760743.004686:0:6411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789760743.004690:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760743.004692:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789760743.004694:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760743.004695:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789760743.004696:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760743.004698:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760743.004699:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789760743.004701:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789760743.004703:0:6411:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789760743.004704:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760743.004706:0:6411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789760743.004791:0:6411:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008138c30e from lustre-MDT0000 10000000:01000000:2.0:1789760743.004819:0:6411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789760743.004832:0:6411:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789760743.004837:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff93309ea30000 10000000:01000000:2.0:1789760743.004841:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760743.004849:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93309ea30000 from 1 10000000:01000000:2.0:1789760743.004853:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760743.004892:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.004903:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.004912:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.004931:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2146824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257728:0@lo:101: 00000100:00100000:2.0:1789760743.004979:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760743.005039:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000acffffc4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.005171:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083257728 00000100:00100000:1.0:1789760743.005178:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083257728 00000100:00100000:1.0:1789760743.005239:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760743.005247:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb571d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+5:6411:x1876700083257728:12345-0@lo:101: 00010000:00010000:1.0:1789760743.005262:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760743.005283:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b71f8 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.005307:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 6 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.005317:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 6 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.005327:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6e60fca, rc 0) 00000100:00100000:1.0:1789760743.005398:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb571d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+6:6411:x1876700083257728:12345-0@lo:101: Request processed in 151us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.005404:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760743.005584:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2146824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257728:0@lo:101: 00010000:00010000:3.0:1789760743.005602:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.005610:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.005687:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257856:0@lo:501: 00000100:00100000:3.0:1789760743.005789:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.005850:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608510dc going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.005888:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083257856 00000100:00100000:1.0:1789760743.005893:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083257856 00000100:00100000:1.0:1789760743.005967:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760743.005974:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036679cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+6:6411:x1876700083257856:12345-0@lo:501: 00000100:00100000:1.0:1789760743.006206:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036679cc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+6:6411:x1876700083257856:12345-0@lo:501: Request processed in 233us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760743.006218:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760743.006378:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257856:0@lo:501: 10000000:01000000:3.0:1789760743.006402:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789760743.006419:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.006427:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760743.006436:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933087a7b000 10000000:01000000:3.0:1789760743.006440:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789760743.006444:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff933087a7b000 10000000:01000000:3.0:1789760743.006446:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789760743.006448:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff933087a7b000 from 1 10000000:01000000:3.0:1789760743.006451:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789760743.006469:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.006476:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.006484:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.006496:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257984:0@lo:101: 00000100:00100000:3.0:1789760743.006527:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.006681:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608510dc going to sleep for 11 seconds 00000100:00100000:0.0:1789760743.006827:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083257984 00000100:00100000:0.0:1789760743.006833:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083257984 00000100:00100000:0.0:1789760743.006858:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760743.006865:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fd9a807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+6:6411:x1876700083257984:12345-0@lo:101: 00010000:00010000:0.0:1789760743.006875:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760743.006887:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c3cc134/0x838c7b3c022b720d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7206 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.006907:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c3cc134/0x838c7b3c022b720d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7206 expref: 7 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.006917:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c3cc134/0x838c7b3c022b720d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7206 expref: 7 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.006926:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c3cc134, rc 0) 00000100:00100000:0.0:1789760743.006971:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fd9a807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+7:6411:x1876700083257984:12345-0@lo:101: Request processed in 107us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.006978:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760743.007060:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083257984:0@lo:101: 00010000:00010000:3.0:1789760743.007071:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b720d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.007078:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b720d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760743.007091:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789760743.007104:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b720d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.007111:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000066dcc7a2/0x838c7b3c022b7206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b720d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760743.007118:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789760743.007122:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789760743.007126:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff933087a7b000 10000000:01000000:3.0:1789760743.007128:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789760743.007131:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789760743.007133:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789760743.007146:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.007153:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.007160:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.007177:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258112:0@lo:101: 00000100:00100000:3.0:1789760743.007220:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.007232:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608510dc going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.007300:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258112 00000100:00100000:1.0:1789760743.007305:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258112 00000100:00100000:1.0:1789760743.007324:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760743.007329:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000915a45fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+7:6411:x1876700083258112:12345-0@lo:101: 00010000:00010000:1.0:1789760743.007336:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760743.007343:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7214 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.007357:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 8 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.007365:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 8 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.007372:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc61142d, rc 0) 00000100:00100000:1.0:1789760743.007395:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000915a45fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+8:6411:x1876700083258112:12345-0@lo:101: Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.007401:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760743.007529:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258112:0@lo:101: 00010000:00010000:3.0:1789760743.007538:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.007545:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.007585:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258240:0@lo:501: 00000100:00100000:3.0:1789760743.007609:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.007631:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608510dc going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.007680:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258240 00000100:00100000:1.0:1789760743.007684:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258240 00000100:00100000:1.0:1789760743.007701:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760743.007706:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f05fa05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+8:6411:x1876700083258240:12345-0@lo:501: 00000100:00100000:1.0:1789760743.008052:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f05fa05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+9:6411:x1876700083258240:12345-0@lo:501: Request processed in 345us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.008059:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760743.008352:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258240:0@lo:501: 00000100:00100000:3.0:1789760743.008386:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258368:0@lo:503: 00000100:00100000:3.0:1789760743.008426:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.008490:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000608510dc going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.008526:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258368 00000100:00100000:1.0:1789760743.008531:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258368 00000100:00100000:1.0:1789760743.008604:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789760743.008611:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085a4adbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+9:6411:x1876700083258368:12345-0@lo:503: 00000100:00100000:1.0:1789760743.008883:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085a4adbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+9:6411:x1876700083258368:12345-0@lo:503: Request processed in 272us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.008890:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760743.008973:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258368:0@lo:503: 00000100:00100000:3.0:1789760743.011437:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6452:1876700083258496:0@lo:502: 00000100:00100000:3.0:1789760743.011517:0:6452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.011567:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019979260 going to sleep for 11 seconds 00000100:00100000:2.0:1789760743.011626:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258496 00000100:00100000:2.0:1789760743.011635:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258496 00000100:00100000:2.0:1789760743.011699:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760743.011778:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002660e907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+9:6452:x1876700083258496:12345-0@lo:502: 00000100:00100000:2.0:1789760743.012032:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002660e907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+9:6452:x1876700083258496:12345-0@lo:502: Request processed in 324us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760743.012040:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760743.012219:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6452:1876700083258496:0@lo:502: 00000020:01000000:3.0:1789760743.012248:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760743.012259:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760743.012385:0:6452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789760743.012392:0:6452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789760743.012501:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760743.012523:0:6452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000059d5049f) 00000020:00000080:2.0:1789760743.012541:0:6452:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789760743.012547:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789760743.012614:0:6452:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789760743.012621:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b7229 00000020:00000080:2.0:1789760743.012988:0:6452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789760743.012998:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760743.013002:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760743.013003:0:6452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789760743.013006:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760743.013010:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760743.013012:0:6452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789760743.013015:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760743.013021:0:6452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002df1c6f5) 00000020:00000080:2.0:1789760743.013031:0:6452:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789760743.013034:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789760743.013036:0:6452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789760743.013038:0:6452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789760743.013044:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789760743.013086:0:6452:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008138c30e from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789760743.013098:0:6452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e978e016) 00000020:00000080:2.0:1789760743.013104:0:6452:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789760743.013153:0:6452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789760743.013167:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b723e 00000020:00000080:2.0:1789760743.013382:0:6452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789760743.013389:0:6452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789760743.013394:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x838c7b3c022b7245 00080000:01000000:2.0:1789760743.013399:0:6452:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789760743.013403:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b724c 00080000:10000000:2.0:1789760743.013869:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789760743.014075:0:6452:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789760743.018817:0:6452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789760743.079663:0:6452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789760743.080108:0:6452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789760743.082977:0:6452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789760743.083377:0:6452:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789760743.116395:0:6452:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fafd08ee) 00000020:00000080:1.0:1789760743.116416:0:6452:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789760743.116495:0:6452:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789760743.116501:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b725a 00000020:00000080:2.0:1789760743.117086:0:6452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789760743.119049:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789760743.152784:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.178418:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.213804:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.243755:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760743.277647:0:6452:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789760743.299642:0:6452:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x838c7b3c022b7261 00000020:00000080:0.0:1789760743.300116:0:6452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789760743.300127:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760743.300132:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760743.300134:0:6452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789760743.300137:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760743.300142:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760743.300144:0:6452:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789760743.300147:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789760743.300177:0:6452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789760743.300219:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760743.300223:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760743.300224:0:6452:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789760743.300226:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760743.300228:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760743.300229:0:6452:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760743.300232:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760743.300233:0:6452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760743.300302:0:6452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6452:1876700083258624:0@lo:502: 00000100:00100000:0.0:1789760743.300399:0:6452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.300439:0:6452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac722e27 going to sleep for 11 seconds 00000100:00100000:2.0:1789760743.300550:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258624 00000100:00100000:2.0:1789760743.300559:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258624 00000100:00100000:2.0:1789760743.300613:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760743.300632:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7d9a1e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+9:6452:x1876700083258624:12345-0@lo:502: 00000100:00100000:2.0:1789760743.300943:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7d9a1e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+9:6452:x1876700083258624:12345-0@lo:502: Request processed in 313us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760743.300963:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789760743.301129:0:6452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6452:1876700083258624:0@lo:502: 00000020:01000000:0.0:1789760743.301156:0:6452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760743.301161:0:6452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760743.301162:0:6452:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760743.301166:0:6452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789760743.301382:0:6411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789760743.301399:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789760743.301418:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.301429:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760743.301437:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933087a7b000 from 1 10000000:01000000:2.0:1789760743.301440:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760743.301471:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.301478:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.301487:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.301502:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e3671b pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258752:0@lo:101: 00000100:00100000:2.0:1789760743.301533:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760743.301568:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c628e8c5 going to sleep for 11 seconds 00000100:00100000:3.0:1789760743.301623:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258752 00000100:00100000:3.0:1789760743.301628:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258752 00000100:00100000:3.0:1789760743.301661:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760743.301668:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043263c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+9:6411:x1876700083258752:12345-0@lo:101: 00010000:00010000:3.0:1789760743.301678:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760743.301690:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7268 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.301713:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 10 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.301723:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 10 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.301732:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005af67960, rc 0) 00000100:00100000:3.0:1789760743.301762:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043263c51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+10:6411:x1876700083258752:12345-0@lo:101: Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760743.301768:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760743.301839:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e3671b pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258752:0@lo:101: 00010000:00010000:2.0:1789760743.301851:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.301869:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.302536:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e3671b pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258880:0@lo:256: 00000100:00100000:2.0:1789760743.302578:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760743.302656:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c628e8c5 going to sleep for 11 seconds 00000100:00100000:3.0:1789760743.302801:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083258880 00000100:00100000:3.0:1789760743.302807:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083258880 00000100:00100000:3.0:1789760743.302841:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760743.302847:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d761910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+10:6411:x1876700083258880:12345-0@lo:256: 20000000:01000000:3.0:1789760743.302863:0:6424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789760743.302868:0:6424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789760743.302958:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d761910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+10:6411:x1876700083258880:12345-0@lo:256: Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760743.302966:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760743.303042:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e3671b pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083258880:0@lo:256: 10000000:01000000:0.0:1789760743.303616:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760743.303628:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.303650:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760743.303657:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933087a7b000 from 1 10000000:01000000:0.0:1789760743.303660:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789760743.303690:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.303697:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.303706:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760743.303721:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259008:0@lo:101: 00000100:00100000:0.0:1789760743.303752:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.303776:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac722e27 going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.303905:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259008 00000100:00100000:1.0:1789760743.303911:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259008 00000100:00100000:1.0:1789760743.303941:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760743.303957:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007df3156b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+10:6411:x1876700083259008:12345-0@lo:101: 00010000:00010000:1.0:1789760743.303967:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760743.303979:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7276 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.304002:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 11 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.304012:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 11 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.304022:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de5d45ae, rc 0) 00000100:00100000:1.0:1789760743.304060:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007df3156b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259008:12345-0@lo:101: Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.304072:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789760743.304149:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259008:0@lo:101: 00010000:00010000:0.0:1789760743.304162:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.304170:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760743.304244:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259136:0@lo:501: 00000100:00100000:0.0:1789760743.304277:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.304292:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac722e27 going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.304382:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259136 00000100:00100000:1.0:1789760743.304386:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259136 00000100:00100000:1.0:1789760743.304404:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760743.304409:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031b92242 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259136:12345-0@lo:501: 00000100:00100000:1.0:1789760743.304906:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031b92242 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259136:12345-0@lo:501: Request processed in 495us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.304913:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789760743.305081:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259136:0@lo:501: 00000100:00100000:0.0:1789760743.305116:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259264:0@lo:503: 00000100:00100000:0.0:1789760743.305153:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.305173:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac722e27 going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.305367:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259264 00000100:00100000:1.0:1789760743.305372:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259264 00000100:00100000:1.0:1789760743.305400:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789760743.305406:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000823932a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259264:12345-0@lo:503: 00000040:00080000:1.0:1789760743.305437:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760743.305474:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000823932a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259264:12345-0@lo:503: Request processed in 69us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.305481:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760743.305578:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259264:0@lo:503: 00000040:00080000:0.0:1789760743.306444:0:6456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789760743.306593:0:6411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789760743.306610:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760743.306666:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.306677:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760743.306719:0:6411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789760743.306722:0:6411:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933087a7b000 10000000:01000000:1.0:1789760743.306725:0:6411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933087a7b000 10000000:01000000:1.0:1789760743.306729:0:6411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760743.306742:0:6411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933087a7b000 from 1 10000000:01000000:1.0:1789760743.306745:0:6411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760743.306777:0:6411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.306786:0:6411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.306796:0:6411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760743.306813:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059b88bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259392:0@lo:101: 00000100:00100000:1.0:1789760743.306858:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760743.306894:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a60f57e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789760743.306940:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259392 00000100:00100000:0.0:1789760743.306956:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259392 00000100:00100000:0.0:1789760743.306998:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760743.307005:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002861dcc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083259392:12345-0@lo:101: 00010000:00010000:0.0:1789760743.307017:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760743.307028:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7284 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.307051:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.307062:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.307071:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009e7b69b5, rc 0) 00000100:00100000:0.0:1789760743.307102:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002861dcc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083259392:12345-0@lo:101: Request processed in 97us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.307108:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789760743.307212:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059b88bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259392:0@lo:101: 00010000:00010000:1.0:1789760743.307225:0:6411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.307234:0:6411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760743.307290:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059b88bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259520:0@lo:501: 00000100:00100000:1.0:1789760743.307315:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760743.307329:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a60f57e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789760743.307440:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259520 00000100:00100000:0.0:1789760743.307444:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259520 00000100:00100000:0.0:1789760743.307471:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760743.307477:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a247834e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083259520:12345-0@lo:501: 00000100:00100000:0.0:1789760743.307730:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a247834e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083259520:12345-0@lo:501: Request processed in 252us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.307737:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789760743.307769:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059b88bfe pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259520:0@lo:501: 00000100:00100000:0.0:1789760743.307797:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259648:0@lo:503: 00000100:00100000:0.0:1789760743.307832:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.307852:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 00000000586636ac going to sleep for 11 seconds 00000100:00100000:0.0:1789760743.307864:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259648 00000100:00100000:0.0:1789760743.307867:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259648 00000100:00100000:0.0:1789760743.307883:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760743.307889:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8c6129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083259648:12345-0@lo:503: 00000100:00100000:0.0:1789760743.308211:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8c6129 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083259648:12345-0@lo:503: Request processed in 321us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.308218:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760743.308255:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083259648:0@lo:503: 00000100:00100000:3.0:1789760743.308910:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6457:1876700083259776:0@lo:502: 00000100:00100000:3.0:1789760743.308964:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.308993:0:6457:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008dc23e8 going to sleep for 11 seconds 00000100:00100000:0.0:1789760743.309040:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259776 00000100:00100000:0.0:1789760743.309045:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259776 00000100:00100000:0.0:1789760743.309082:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760743.309088:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec89b8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6457:x1876700083259776:12345-0@lo:502: 00000100:00100000:0.0:1789760743.309336:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec89b8ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6457:x1876700083259776:12345-0@lo:502: Request processed in 248us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.309343:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760743.309485:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002746ea1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6457:1876700083259776:0@lo:502: 00000020:01000004:2.0:1789760743.309545:0:6457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789760743.309559:0:6457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000db295a13) 00000020:00000080:2.0:1789760743.309575:0:6457:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789760743.309646:0:6457:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008138c30e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789760743.309650:0:6457:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008138c30e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789760743.309653:0:6457:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008138c30e 4 00010000:00080000:2.0:1789760743.309684:0:6457:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008526bbc8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1789760743.311747:0:6457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789760743.312024:0:6457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789760743.312056:0:6457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760743.312073:0:6457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x838c7b3c022b7299 00000100:00080000:0.0:1789760743.312083:0:6457:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760743.312088:0:6457:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008526bbc8 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760743.312125:0:6457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fae8a7c9 x1876700083259904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760743.312152:0:6457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789760743.312367:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3427:1876700083259904:0@lo:38: 00000100:00100000:2.0:1789760743.312453:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.312610:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083259904 00000100:00100000:0.0:1789760743.312620:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083259904 00000100:00100000:0.0:1789760743.312659:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760743.312666:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006269e57f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3427:x1876700083259904:12345-0@lo:38: 00000100:00100000:0.0:1789760743.312725:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006269e57f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3427:x1876700083259904:12345-0@lo:38: Request processed in 58us (272us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789760743.312733:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760743.312783:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760743.312792:0:3427:0:(import.c:65:import_set_state_nolock()) 000000008526bbc8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789760743.312797:0:3427:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789760743.312800:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3427:1876700083259904:0@lo:38: 00000100:00100000:1.0:1789760743.315077:0:6457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001032719f pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6457:1876700083260032:0@lo:502: 00000100:00100000:1.0:1789760743.315154:0:6457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760743.315215:0:6457:0:(client.c:2715:ptlrpc_set_wait()) set 000000009dbfb28d going to sleep for 11 seconds 00000100:00100000:3.0:1789760743.316397:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260032 00000100:00100000:3.0:1789760743.316410:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260032 00000100:00100000:3.0:1789760743.316470:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760743.316480:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007890ebc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:6457:x1876700083260032:12345-0@lo:502: 00000100:00100000:3.0:1789760743.316738:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007890ebc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:6457:x1876700083260032:12345-0@lo:502: Request processed in 258us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760743.316746:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789760743.316812:0:6457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001032719f pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:6457:1876700083260032:0@lo:502: 00000040:00080000:3.0:1789760743.316846:0:6457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789760743.318382:0:6411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789760743.318412:0:6411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760743.318432:0:6411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760743.318444:0:6411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789760743.318494:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789760743.318497:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789760743.318498:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760743.318499:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760743.318506:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760743.318507:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760743.318509:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760743.318510:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789760743.318511:0:6411:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760743.318512:0:6411:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760743.318514:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760743.318515:0:6411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760743.318518:0:6411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789760743.318521:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789760743.318522:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789760743.318523:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760743.318523:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760743.318524:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760743.318525:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760743.318526:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760743.318527:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789760743.318528:0:6411:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760743.318529:0:6411:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760743.318529:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760743.318530:0:6411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789760743.318557:0:6411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789760743.318573:0:6411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083260160:0@lo:253: 00000100:00100000:0.0:1789760743.318629:0:6411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760743.318661:0:6411:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c1fa31c going to sleep for 11 seconds 00000100:00100000:3.0:1789760743.319307:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260160 00000100:00100000:3.0:1789760743.319316:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260160 00000100:00100000:3.0:1789760743.319371:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760743.319379:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000095c4b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:6411:x1876700083260160:12345-0@lo:253: 20000000:01000000:3.0:1789760743.319406:0:6424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789760743.319420:0:6424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789760743.357097:0:6424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789760743.357117:0:6424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789760743.357208:0:6445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789760743.357213:0:6445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789760743.357235:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.357256:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.357283:0:6445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.357329:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.357343:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 12 pid: 6425 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.357358:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f0141a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083260288:0@lo:104: 00000100:00100000:3.0:1789760743.357427:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760743.357483:0:6445:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bdd0525 going to sleep for 11 seconds 00000100:00100000:1.0:1789760743.357641:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260288 00000100:00100000:1.0:1789760743.357652:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260288 00000100:00100000:1.0:1789760743.357714:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760743.357725:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000193b5140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083260288:12345-0@lo:104: 00010000:00010000:1.0:1789760743.357741:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760743.357802:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760743.357809:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000193b5140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083260288:12345-0@lo:104: Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760743.357816:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789760743.357910:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760743.357918:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.357926:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026743dcd already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760743.357929:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.357937:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760743.357965:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760743.357971:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760743.358008:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358014:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760743.358031:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358037:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 0000000026743dcd/0x838c7b3c022b7268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b726f expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358052:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760743.358053:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760743.358055:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760743.358104:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edc5558d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083260416:0@lo:103: 00000100:00100000:2.0:1789760743.358133:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760743.358227:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260416 00000100:00100000:2.0:1789760743.358231:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260416 00010000:00010000:2.0:1789760743.358247:0:6415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 13 pid: 6425 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760743.358270:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760743.358275:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d42c174e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+13:3429:x1876700083260416:12345-0@lo:103: 00010000:00010000:2.0:1789760743.358285:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760743.358289:0:6415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 13 pid: 6425 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358305:0:6415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 13 pid: 6425 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358321:0:6415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358329:0:6415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760743.358342:0:6415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001129758s 00010000:00010000:2.0:1789760743.358345:0:6415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358352:0:6415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358357:0:6415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358361:0:6415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358366:0:6415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a624207 already unused, calling callback (00000000d208beed) 00010000:00010000:2.0:1789760743.358369:0:6415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358375:0:6415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358381:0:6415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760743.358398:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760743.358425:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d42c174e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+13:3429:x1876700083260416:12345-0@lo:103: Request processed in 150us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760743.358431:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760743.358475:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edc5558d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083260416:0@lo:103: 00010000:00010000:3.0:1789760743.358668:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005af67960/0x838c7b3c022b726f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7268 expref: 12 pid: 6425 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760743.358681:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f0141a7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083260288:0@lo:104: 00010000:00010000:3.0:1789760743.358694:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.358702:0:6445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.358708:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760743.358713:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009a624207/0x838c7b3c022b72a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760743.365904:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000095c4b9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+11:6411:x1876700083260160:12345-0@lo:253: Request processed in 46518us (47268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760743.365922:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760743.366061:0:6411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fae8a7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:6411:1876700083260160:0@lo:253: 10000000:01000000:1.0:1789760743.366080:0:6411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789760743.366084:0:6411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760743.366086:0:6411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789760743.366088:0:6411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760743.366089:0:6411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760743.366090:0:6411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760743.366091:0:6411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760743.366093:0:6411:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760743.366094:0:6411:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789760743.366096:0:6411:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760743.366097:0:6411:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760743.366099:0:6411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760743.366100:0:6411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789760743.366117:0:6411:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789760743.372357:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.372934:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760743.373119:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.373318:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789760743.373500:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789760743.373655:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760743.374431:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760743.374553:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760743.374884:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760743.375383:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760743.375643:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760743.375847:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789760743.415752:0:6411:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789760743.458080:0:6411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789760743.458990:0:6462:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789760743.458998:0:6462:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789760743.461537:0:6463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789760743.464840:0:6411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789760743.465105:0:6411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789760743.466279:0:6411:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789760743.466291:0:6411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789760743.466510:0:6411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760743.467673:0:6411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789760743.468370:0:6411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789760743.468399:0:6411:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789760743.468661:0:6411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789760743.468897:0:6411:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789760743.479450:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789760743.479666:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789760743.479825:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789760743.479982:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789760743.480617:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789760743.480758:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789760743.481598:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789760743.481741:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789760743.482403:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789760743.482559:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789760743.482689:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789760743.482857:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789760743.483009:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789760743.483151:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789760743.483336:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789760743.483511:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789760743.483804:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789760743.483966:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789760743.484130:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789760743.484302:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789760743.484434:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789760743.484569:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789760743.484683:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789760743.484829:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789760743.485446:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789760743.485619:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789760743.485752:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789760743.485896:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789760743.486222:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789760743.486383:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789760743.486536:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789760743.486697:0:6411:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789760743.486883:0:6411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789760743.509243:0:6463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789760743.559625:0:6411:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789760743.559663:0:6411:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc8941c53988 00100000:10000000:3.0:1789760743.559669:0:6411:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789760743.560458:0:6411:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789760743.560472:0:6411:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789760743.560488:0:6411:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789760743.560512:0:6411:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789760743.564646:0:6463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789760743.564733:0:6463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789760743.564738:0:6463:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789760743.750311:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760744.779032:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760745.798582:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760746.827133:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760747.291252:0:6706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789760747.849140:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789760748.422322:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789760748.422332:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789760748.422336:0:8:0:(import.c:65:import_set_state_nolock()) 000000008526bbc8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789760748.422349:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008526bbc8 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760748.422375:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093fc0e6e x1876700083260672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760748.422415:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093fc0e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3427:1876700083260672:0@lo:38: 00000100:00100000:0.0:1789760748.422481:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760748.422630:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051e7576e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083260544:0@lo:400: 00000100:00100000:3.0:1789760748.422671:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760748.422697:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260672 00000100:00100000:1.0:1789760748.422707:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260672 00000100:00100000:1.0:1789760748.422862:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760748.422870:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6217cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3427:x1876700083260672:12345-0@lo:38: 00010000:00080000:1.0:1789760748.422897:0:6431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:1.0:1789760748.422936:0:6431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x838c7b3c022b72a7 00000004:00100000:1.0:1789760748.422988:0:6431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789760748.423091:0:6431:0:(import.c:65:import_set_state_nolock()) 0000000098d025aa : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760748.423147:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6217cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3427:x1876700083260672:12345-0@lo:38: Request processed in 276us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760748.423154:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760748.423306:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260544 00000100:00100000:0.0:1789760748.423311:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260544 00000100:00100000:0.0:1789760748.423350:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789760748.423358:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000620c33f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:3430:x1876700083260544:12345-0@lo:400: 00000100:00100000:0.0:1789760748.423412:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000620c33f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:3430:x1876700083260544:12345-0@lo:400: Request processed in 55us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760748.423420:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789760748.423466:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000093fc0e6e x1876700083260672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789760748.423481:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789760748.423488:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789760748.423492:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789760748.423494:0:3427:0:(import.c:65:import_set_state_nolock()) 000000008526bbc8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789760748.423508:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093fc0e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3427:1876700083260672:0@lo:38: 00000100:00100000:3.0:1789760748.423584:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051e7576e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083260544:0@lo:400: 00010000:00010000:0.0:1789760748.872355:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760749.896942:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760750.918633:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760751.942533:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789760752.519978:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789760752.519989:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933087a7b000 from 3 10000000:01000000:3.0:1789760752.519994:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789760752.520040:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.520052:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760752.520061:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760752.520088:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f0141a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083260800:0@lo:101: 00000100:00100000:3.0:1789760752.520163:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760752.520341:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000002146421a going to sleep for 11 seconds 00000100:00100000:0.0:1789760752.524119:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260800 00000100:00100000:0.0:1789760752.524138:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260800 00000100:00100000:0.0:1789760752.525301:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789760752.525316:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096fab613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+11:6427:x1876700083260800:12345-0@lo:101: 00010000:00010000:0.0:1789760752.525335:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760752.525358:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b72ae expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.525386:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 12 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.525398:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 12 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.525407:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054df97f2, rc 0) 00000100:00100000:0.0:1789760752.525502:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096fab613 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:6427:x1876700083260800:12345-0@lo:101: Request processed in 191us (5339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760752.525510:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789760752.525750:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f0141a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083260800:0@lo:101: 00010000:00010000:2.0:1789760752.525772:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760752.525781:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760752.525924:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edc5558d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083260928:0@lo:256: 00000100:00100000:2.0:1789760752.525971:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760752.526012:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075324874 going to sleep for 11 seconds 00000100:00100000:1.0:1789760752.526072:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083260928 00000100:00100000:1.0:1789760752.526079:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083260928 00000100:00100000:1.0:1789760752.526119:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760752.526126:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0c313c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6427:x1876700083260928:12345-0@lo:256: 20000000:01000000:1.0:1789760752.526141:0:6425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760752.526159:0:6425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760752.526162:0:6425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789760752.526337:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0c313c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:6427:x1876700083260928:12345-0@lo:256: Request processed in 211us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760752.526344:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760752.526426:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edc5558d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083260928:0@lo:256: 10000000:01000000:2.0:1789760752.526469:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760752.526476:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760752.526484:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760752.966737:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760753.544531:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760753.544559:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093fc0e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083261056:0@lo:400: 00000100:00100000:0.0:1789760753.544643:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760753.546404:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261056 00000100:00100000:1.0:1789760753.546417:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261056 00000100:00100000:1.0:1789760753.546479:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760753.546488:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c78dcc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:3430:x1876700083261056:12345-0@lo:400: 00000100:00100000:1.0:1789760753.546581:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c78dcc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:3430:x1876700083261056:12345-0@lo:400: Request processed in 94us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.546590:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789760753.546648:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093fc0e6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083261056:0@lo:400: 00000100:00100000:2.0:1789760753.551099:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a834a6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083261184:0@lo:400: 00000100:00100000:2.0:1789760753.551679:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760753.552299:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261184 00000100:00100000:1.0:1789760753.552309:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261184 00000100:00100000:1.0:1789760753.552359:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760753.552368:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc5558d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083261184:12345-0@lo:400: 00000100:00100000:1.0:1789760753.552437:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc5558d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083261184:12345-0@lo:400: Request processed in 70us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760753.552444:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760753.554417:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a834a6c x1876700083261184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760753.554440:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a834a6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083261184:0@lo:400: 00010000:00010000:0.0:1789760753.990808:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760755.014460:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760756.038939:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789760756.127992:0:7226:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789760756.127996:0:7226:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt2/mdt2 00000080:01200004:1.0:1789760756.128129:0:7226:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f64386eb 00000020:01000004:1.0:1789760756.128146:0:7226:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-zfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789760756.128159:0:7226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789760756.128212:0:7226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000dccfd6aa) 00000020:00000080:1.0:1789760756.128228:0:7226:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789760756.150652:0:7226:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1789760756.151592:0:7226:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789760756.178555:0:7226:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789760756.178592:0:7226:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789760756.178612:0:7226:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789760756.178660:0:7226:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789760756.178685:0:7226:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789760756.179150:0:7226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789760756.179163:0:7226:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789760756.179174:0:7226:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b72c3 00000020:01000004:1.0:1789760756.179270:0:7226:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device lustre-mdt2/mdt2 00000020:01000004:1.0:1789760756.179297:0:7226:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789760756.179300:0:7226:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789760756.179685:0:7226:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789760756.179717:0:7226:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt2/mdt2 10000000:01000000:1.0:1789760756.179728:0:7226:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789760756.198174:0:7226:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789760756.198491:0:7226:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.153@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1789760756.198496:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789760756.198498:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789760756.198499:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760756.198500:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760756.198511:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760756.198513:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760756.198515:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760756.198516:0:7226:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760756.198518:0:7226:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760756.198519:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760756.198521:0:7226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760756.198524:0:7226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1789760756.198527:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760756.198528:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789760756.198529:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760756.198530:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760756.198530:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760756.198531:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760756.198532:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760756.198533:0:7226:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760756.198534:0:7226:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760756.198535:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760756.198536:0:7226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789760756.198578:0:7226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789760756.198598:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083261312:0@lo:253: 00000100:00100000:1.0:1789760756.198678:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.198739:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b60ae91 going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.199551:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261312 00000100:00100000:0.0:1789760756.199563:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261312 00000100:00100000:0.0:1789760756.199630:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760756.199639:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe8d432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083261312:12345-0@lo:253: 20000000:01000000:0.0:1789760756.199686:0:6422:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789760756.199690:0:6422:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789760756.199695:0:6422:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789760756.199698:0:6422:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789760756.199996:0:6422:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789760756.200822:0:6422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760756.201282:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789760756.201298:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760756.201339:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789760756.201387:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789760756.201423:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789760756.202453:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789760756.202470:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789760756.202793:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789760756.202803:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789760756.202965:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789760756.202979:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789760756.203011:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789760756.203053:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789760756.203683:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789760756.203695:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:3.0:1789760756.203721:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789760756.203728:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760756.203780:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789760756.203789:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:3.0:1789760756.203815:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789760756.203821:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789760756.203868:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789760756.204037:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789760756.204069:0:6422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789760756.204490:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789760756.204503:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789760756.204687:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 160 off11176 00000040:00080000:3.0:1789760756.204753:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11400 00000040:00080000:3.0:1789760756.204801:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11624 20000000:01000000:3.0:1789760756.204810:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789760756.204864:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 80 off11704 00000040:00080000:3.0:1789760756.205076:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789760756.205086:0:6422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789760756.205168:0:6422:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789760756.205176:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789760756.205600:0:7228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789760756.206039:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789760756.206063:0:6422:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.153@tcp for mdt 20000000:01000000:3.0:1789760756.206066:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:3.0:1789760756.206101:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789760756.206109:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789760756.206153:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789760756.206160:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:3.0:1789760756.206312:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789760756.206323:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789760756.206355:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789760756.206392:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789760756.206838:0:6422:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789760756.206848:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1789760756.207622:0:7229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789760756.207943:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789760756.207968:0:6422:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.153@tcp for mdt 20000000:01000000:3.0:1789760756.207970:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:3.0:1789760756.208006:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789760756.208014:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789760756.208066:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789760756.208074:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:3.0:1789760756.208103:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789760756.208112:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789760756.208141:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789760756.208422:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789760756.208515:0:6422:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789760756.208518:0:6422:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789760756.208523:0:6422:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789760756.208530:0:6422:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789760756.209748:0:7230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 17 count 22 20000000:00000400:3.0:1789760756.209966:0:6422:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 20000000:01000000:3.0:1789760756.225115:0:6422:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789760756.225121:0:6422:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789760756.225125:0:6422:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789760756.225147:0:6422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789760756.225150:0:6422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789760756.225265:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789760756.225269:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760756.226126:0:7231:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760756.226317:0:7231:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760756.226371:0:7231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789760756.226679:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789760756.226720:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789760756.226751:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789760756.226763:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789760756.226765:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789760756.227711:0:7232:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 19 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789760756.227772:0:7232:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 21 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789760756.227809:0:7232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789760756.228119:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789760756.228162:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789760756.228430:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789760756.228445:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789760756.228447:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760756.229132:0:7233:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760756.229421:0:7233:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760756.229470:0:7233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789760756.229787:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789760756.229827:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789760756.229976:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1789760756.229995:0:6422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789760756.230015:0:6422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230036:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 12 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230043:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230048:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230055:0:6422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230106:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230123:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.230139:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261440:0@lo:104: 00000100:00100000:1.0:1789760756.230249:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760756.230301:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230309:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.230329:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261568:0@lo:104: 00000100:00100000:1.0:1789760756.230352:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760756.230378:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 12 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.230385:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 12 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.230393:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c05b070 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261696:0@lo:104: 00000100:00100000:1.0:1789760756.230409:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.230418:0:6422:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019979260 going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.230616:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261440 00000100:00100000:0.0:1789760756.230625:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261440 00000100:00100000:0.0:1789760756.230665:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261568 00000100:00100000:0.0:1789760756.230668:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261568 00000100:00100000:0.0:1789760756.230676:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261696 00000100:00100000:0.0:1789760756.230678:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261696 00000100:00100000:0.0:1789760756.230690:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760756.230699:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052715096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+5:6422:x1876700083261440:12345-0@lo:104: 00010000:00010000:0.0:1789760756.230713:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.230776:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760756.230781:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052715096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+5:6422:x1876700083261440:12345-0@lo:104: Request processed in 84us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.230789:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760756.230805:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760756.230811:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da11d66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083261568:12345-0@lo:104: 00010000:00010000:0.0:1789760756.230826:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.230870:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760756.230874:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da11d66 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083261568:12345-0@lo:104: Request processed in 65us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.230880:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.230992:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261440:0@lo:104: 00000100:00100000:1.0:1789760756.231002:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261568:0@lo:104: 00000100:00100000:0.0:1789760756.231130:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760756.231136:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba555b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083261696:12345-0@lo:104: 00010000:00010000:0.0:1789760756.231144:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231227:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789760756.231232:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba555b23 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083261696:12345-0@lo:104: Request processed in 98us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.231237:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789760756.231254:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789760756.231261:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231268:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007b4f075d already unused, calling callback (0000000059ad114f) 10000000:00010000:0.0:1789760756.231271:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231279:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760756.231286:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760756.231297:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760756.231335:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231342:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760756.231359:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231364:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000007b4f075d/0x838c7b3c022b7284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b728b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231376:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789760756.231378:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231382:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000073c64a13 already unused, calling callback (0000000059ad114f) 10000000:00010000:0.0:1789760756.231384:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231390:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760756.231394:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760756.231399:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789760756.231489:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c05b070 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083261696:0@lo:104: 00010000:00010000:1.0:1789760756.231585:0:6422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231743:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231750:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789760756.231795:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789760756.231811:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231817:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b7214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b721b expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231829:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760756.231831:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231837:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006a1ff53a already unused, calling callback (0000000059ad114f) 10000000:00010000:0.0:1789760756.231839:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231845:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760756.231861:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760756.231866:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760756.231879:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.231891:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789760756.231915:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760756.231927:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b921da27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083262080:0@lo:103: 00000100:00100000:1.0:1789760756.231959:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.232002:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262080 00000100:00100000:1.0:1789760756.232007:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262080 00010000:00010000:1.0:1789760756.232024:0:6415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 13 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.232047:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760756.232053:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c05b070 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+13:3430:x1876700083262080:12345-0@lo:103: 00010000:00010000:1.0:1789760756.232069:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760756.232073:0:6415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 13 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232082:0:6415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 13 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232095:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6e60fca/0x838c7b3c022b71ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b71f8 expref: 13 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232111:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760756.232136:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c05b070 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+12:3430:x1876700083262080:12345-0@lo:103: Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.232142:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760756.232209:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b921da27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083262080:0@lo:103: 00000100:00100000:2.0:1789760756.232430:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098a55882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083261952:0@lo:103: 00000100:00100000:2.0:1789760756.232459:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.232560:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261952 00000100:00100000:1.0:1789760756.232565:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261952 00010000:00010000:1.0:1789760756.232580:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.232600:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.232606:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065a0dda3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+12:3431:x1876700083261952:12345-0@lo:103: 00010000:00010000:1.0:1789760756.232613:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760756.232616:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232624:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232646:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc61142d/0x838c7b3c022b721b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7214 expref: 12 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.232655:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760756.232683:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065a0dda3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+11:3431:x1876700083261952:12345-0@lo:103: Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.232690:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.232715:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098a55882 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083261952:0@lo:103: 00010000:00010000:0.0:1789760756.233159:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233286:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760756.233322:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000006a1ff53a/0x838c7b3c022b71f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b71ff expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.233339:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760756.233348:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760756.233350:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760756.233364:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c569d9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083261824:0@lo:103: 00000100:00100000:0.0:1789760756.233396:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.233636:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083261824 00000100:00100000:1.0:1789760756.233644:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083261824 00010000:00010000:1.0:1789760756.233663:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 11 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.233693:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760756.233700:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db5da0de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+11:3429:x1876700083261824:12345-0@lo:103: 00010000:00010000:1.0:1789760756.233709:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760756.233713:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 11 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233723:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 11 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233734:0:6416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009e7b69b5/0x838c7b3c022b728b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7284 expref: 11 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233746:0:6416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233763:0:6416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233777:0:6416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233783:0:6416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233789:0:6416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233794:0:6416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233799:0:6416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044791a12 already unused, calling callback (00000000d208beed) 00010000:00010000:1.0:1789760756.233803:0:6416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233810:0:6416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233824:0:6416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233833:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760756.233890:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db5da0de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+10:3429:x1876700083261824:12345-0@lo:103: Request processed in 181us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.233897:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760756.233933:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c569d9ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083261824:0@lo:103: 00010000:00010000:1.0:1789760756.233960:0:6422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233968:0:6422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.233973:0:6422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044791a12/0x838c7b3c022b72ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760756.233987:0:6422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789760756.287298:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe8d432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+9:7226:x1876700083261312:12345-0@lo:253: Request processed in 87651us (88611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.287314:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760756.287473:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083261312:0@lo:253: 10000000:01000000:0.0:1789760756.287490:0:7226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789760756.287494:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760756.287496:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789760756.287497:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760756.287498:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789760756.287500:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760756.287501:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760756.287503:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789760756.287505:0:7226:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789760756.287506:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760756.287508:0:7226:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789760756.287528:0:7226:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f64386eb from lustre-MDT0001 10000000:01000000:0.0:1789760756.287554:0:7226:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789760756.287557:0:7226:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789760756.287563:0:7226:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93309ea30000 local copy 10000000:01000000:0.0:1789760756.287568:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789760756.287609:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.287620:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.287631:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.287648:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262208:0@lo:101: 00000100:00100000:0.0:1789760756.287686:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.287747:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000081a18e6 going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.287879:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262208 00000100:00100000:2.0:1789760756.287895:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262208 00000100:00100000:2.0:1789760756.288039:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789760756.288050:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea064590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+9:7226:x1876700083262208:12345-0@lo:101: 00010000:00010000:2.0:1789760756.288067:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760756.288082:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000754d2854/0x838c7b3c022b72d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b72d1 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.288108:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000754d2854/0x838c7b3c022b72d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b72d1 expref: 10 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.288120:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000754d2854/0x838c7b3c022b72d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72d1 expref: 10 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.288142:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000754d2854, rc 0) 00000100:00100000:2.0:1789760756.288211:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea064590 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+10:7226:x1876700083262208:12345-0@lo:101: Request processed in 163us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.288217:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789760756.288286:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262208:0@lo:101: 00010000:00010000:0.0:1789760756.288299:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.288308:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.288413:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262336:0@lo:501: 00000100:00100000:0.0:1789760756.288440:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.288726:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000081a18e6 going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.288798:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262336 00000100:00100000:1.0:1789760756.288804:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262336 00000100:00100000:1.0:1789760756.288830:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760756.288837:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040692f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+10:7226:x1876700083262336:12345-0@lo:501: 00000100:00100000:1.0:1789760756.289323:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040692f41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+10:7226:x1876700083262336:12345-0@lo:501: Request processed in 484us (881us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760756.289332:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789760756.289570:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262336:0@lo:501: 10000000:01000000:1.0:1789760756.289693:0:7226:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789760756.289728:0:7226:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789760756.289734:0:7226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.289745:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.289753:0:7226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.289812:0:7226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789760756.289840:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933099616800 10000000:01000000:1.0:1789760756.289845:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789760756.289861:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff93309ea30000 10000000:01000000:1.0:1789760756.289864:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789760756.289867:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff93309ea30000 from 1 10000000:01000000:1.0:1789760756.289869:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789760756.290023:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.290032:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.290042:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.290060:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262464:0@lo:101: 00000100:00100000:1.0:1789760756.290095:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.290131:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5d10d53 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.290435:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262464 00000100:00100000:3.0:1789760756.290441:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262464 00000100:00100000:3.0:1789760756.290484:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789760756.290492:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1836a2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+10:7226:x1876700083262464:12345-0@lo:101: 00010000:00010000:3.0:1789760756.290504:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.290517:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069683f65/0x838c7b3c022b72e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b72df expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.290541:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069683f65/0x838c7b3c022b72e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b72df expref: 11 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.290551:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069683f65/0x838c7b3c022b72e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72df expref: 11 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.290561:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069683f65, rc 0) 00000100:00100000:3.0:1789760756.290605:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1836a2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+11:7226:x1876700083262464:12345-0@lo:101: Request processed in 114us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.290611:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789760756.290706:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262464:0@lo:101: 00010000:00010000:0.0:1789760756.290719:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72e6 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.290728:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b72e6 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760756.290745:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789760756.290763:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72e6 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.290770:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000044791a12/0x838c7b3c022b72df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72e6 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760756.290779:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff933099616800 10000000:01000000:0.0:1789760756.290783:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789760756.290794:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff933099616800 from 1 10000000:01000000:0.0:1789760756.290796:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789760756.290814:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.290821:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.290827:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760756.290840:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ec98f4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262592:0@lo:101: 00000100:00100000:0.0:1789760756.290876:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.290905:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000081a18e6 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.291073:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262592 00000100:00100000:3.0:1789760756.291078:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262592 00000100:00100000:3.0:1789760756.291107:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760756.291115:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070f87ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+11:7226:x1876700083262592:12345-0@lo:101: 00010000:00010000:3.0:1789760756.291123:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.291132:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005af67960/0x838c7b3c022b72f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b72ed expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291145:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005af67960/0x838c7b3c022b72f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b72ed expref: 12 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291153:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005af67960/0x838c7b3c022b72f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72ed expref: 12 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291159:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005af67960, rc 0) 00000100:00100000:3.0:1789760756.291466:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070f87ade pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083262592:12345-0@lo:101: Request processed in 351us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.291472:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760756.291507:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ec98f4c pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262592:0@lo:101: 00010000:00010000:3.0:1789760756.291517:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72f4 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291524:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b72f4 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760756.291539:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789760756.291547:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72f4 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291564:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000001d58a10a/0x838c7b3c022b72ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b72f4 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760756.291571:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789760756.291574:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789760756.291579:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff933099616800 10000000:01000000:3.0:1789760756.291581:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789760756.291583:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789760756.291585:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789760756.291602:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291608:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291615:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.291628:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262720:0@lo:101: 00000100:00100000:3.0:1789760756.291653:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.291671:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfca7dbb going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.291688:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262720 00000100:00100000:3.0:1789760756.291691:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262720 00000100:00100000:3.0:1789760756.291711:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760756.291717:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000074d551a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083262720:12345-0@lo:101: 00010000:00010000:3.0:1789760756.291724:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.291732:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fddf10e/0x838c7b3c022b7302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b72fb expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291754:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fddf10e/0x838c7b3c022b7302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 13 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291761:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fddf10e/0x838c7b3c022b7302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 13 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291766:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fddf10e, rc 0) 00000100:00100000:3.0:1789760756.291795:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000074d551a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083262720:12345-0@lo:101: Request processed in 78us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.291800:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760756.291828:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262720:0@lo:101: 00010000:00010000:3.0:1789760756.291836:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.291843:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.293640:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262848:0@lo:501: 00000100:00100000:3.0:1789760756.293698:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760756.293792:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760756.293801:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.293812:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004d719913 already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760756.293815:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.293823:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760756.293830:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.293835:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789760756.294015:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfca7dbb going to sleep for 11 seconds 00010000:00010000:2.0:1789760756.295492:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.295505:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760756.295539:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.295547:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000004d719913/0x838c7b3c022b72d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b72d8 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.295583:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760756.295586:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760756.295588:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760756.295703:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760756.295725:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d5a1594 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083262976:0@lo:103: 00000100:00100000:3.0:1789760756.295778:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.295874:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262976 00000100:00100000:2.0:1789760756.295884:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262976 00000100:00100000:2.0:1789760756.295959:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760756.295969:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b46adea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+13:3429:x1876700083262976:12345-0@lo:103: 00010000:00010000:2.0:1789760756.295982:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760756.295999:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000754d2854/0x838c7b3c022b72d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x838c7b3c022b72d1 expref: 13 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.296013:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760756.296049:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b46adea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+12:3429:x1876700083262976:12345-0@lo:103: Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.296057:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760756.296221:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d5a1594 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083262976:0@lo:103: 00000100:00100000:1.0:1789760756.296520:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083262848 00000100:00100000:1.0:1789760756.296525:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083262848 00000100:00100000:1.0:1789760756.296561:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789760756.296568:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061f1c71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083262848:12345-0@lo:501: 00000100:00100000:1.0:1789760756.296916:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061f1c71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083262848:12345-0@lo:501: Request processed in 348us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.296924:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760756.297132:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083262848:0@lo:501: 00000100:00100000:3.0:1789760756.297333:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263104:0@lo:503: 00000100:00100000:3.0:1789760756.297383:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.297450:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfca7dbb going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.297489:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263104 00000100:00100000:1.0:1789760756.297494:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263104 00000100:00100000:1.0:1789760756.297562:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760756.297570:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017dace77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263104:12345-0@lo:503: 00000100:00100000:1.0:1789760756.297767:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017dace77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263104:12345-0@lo:503: Request processed in 198us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.297781:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760756.297834:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008509fa14 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263104:0@lo:503: 00000040:00080000:0.0:1789760756.298437:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760756.298509:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001dc6aecc pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263232:0@lo:502: 00000100:00100000:0.0:1789760756.298552:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.298621:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7c2dbc4 going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.298675:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263232 00000100:00100000:1.0:1789760756.298681:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263232 00000100:00100000:1.0:1789760756.298716:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789760756.298723:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053b1306e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263232:12345-0@lo:502: 00000100:00100000:1.0:1789760756.299043:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053b1306e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263232:12345-0@lo:502: Request processed in 320us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.299050:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760756.299157:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001dc6aecc pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263232:0@lo:502: 00000040:00080000:2.0:1789760756.299521:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789760756.299570:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789760756.299616:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789760756.299650:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789760756.299683:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789760756.299745:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789760756.299790:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789760756.299823:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789760756.300051:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789760756.300095:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789760756.300126:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789760756.300370:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789760756.300418:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789760756.300454:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789760756.300498:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789760756.300531:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789760756.300562:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 160 off11176 00000040:00080000:3.0:1789760756.300608:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11400 00000040:00080000:3.0:1789760756.300641:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11624 00000040:00080000:3.0:1789760756.300673:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 80 off11704 00000040:00080000:3.0:1789760756.300718:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789760756.300753:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789760756.300786:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789760756.300828:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263360:0@lo:502: 00000100:00100000:3.0:1789760756.300903:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.301105:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 000000000643c930 going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.301147:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263360 00000100:00100000:1.0:1789760756.301155:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263360 00000100:00100000:1.0:1789760756.301490:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789760756.301500:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039e4986c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263360:12345-0@lo:502: 00000100:00100000:1.0:1789760756.301750:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039e4986c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263360:12345-0@lo:502: Request processed in 251us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.301759:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789760756.301862:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263360:0@lo:502: 00000040:00080000:3.0:1789760756.302101:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789760756.302116:0:7226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789760756.302804:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760756.302820:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760756.302822:0:7234:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789760756.302828:0:7234:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789760756.302830:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760756.302859:0:7234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000006c9231c1) 00000020:00000080:2.0:1789760756.302879:0:7234:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789760756.302886:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789760756.303090:0:7234:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789760756.303097:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b7310 00000020:00000080:0.0:1789760756.303501:0:7234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789760756.303506:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760756.303510:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760756.303512:0:7234:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789760756.303515:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760756.303518:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760756.303520:0:7234:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789760756.303523:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760756.303530:0:7234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000070e2c761) 00000020:00000080:0.0:1789760756.303542:0:7234:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1789760756.303546:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789760756.303553:0:7234:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789760756.303556:0:7234:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789760756.303563:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760756.303614:0:7234:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f64386eb from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789760756.303626:0:7234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000ff02666f) 00000020:00000080:0.0:1789760756.303636:0:7234:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1789760756.303689:0:7234:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789760756.303695:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b7325 00000020:00000080:0.0:1789760756.303783:0:7234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789760756.303789:0:7234:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789760756.303795:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x838c7b3c022b732c 00080000:01000000:0.0:1789760756.303800:0:7234:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789760756.303804:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b7333 00080000:10000000:0.0:1789760756.304658:0:7234:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789760756.304806:0:7234:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1789760756.376648:0:7234:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789760756.383811:0:7234:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789760756.390686:0:7234:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789760756.391112:0:7234:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789760756.547759:0:7234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789760756.547773:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760756.547778:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760756.547780:0:7234:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789760756.547783:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760756.547789:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760756.547790:0:7234:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789760756.547793:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789760756.547798:0:7234:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:00000080:0.0:1789760756.547824:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760756.547838:0:7234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000002c94419) 00000020:00000080:0.0:1789760756.547872:0:7234:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789760756.547878:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789760756.547937:0:7234:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789760756.547944:0:7234:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789760756.547951:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b7341 00010000:00080000:0.0:1789760756.547993:0:7234:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000935d9507@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1789760756.552563:0:7234:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789760756.553767:0:7234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789760756.553780:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789760756.553807:0:7234:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789760756.553824:0:7234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b7348 00000100:00080000:1.0:1789760756.553834:0:7234:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760756.553839:0:7234:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000935d9507 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1789760756.553889:0:7234:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058bf1e2b x1876700083263488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760756.553945:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083263488:0@lo:38: 00000100:00100000:0.0:1789760756.554013:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789760756.554073:0:7234:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789760756.554138:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e561e8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083263616:0@lo:400: 00000100:00100000:1.0:1789760756.554250:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.554303:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263616 00000100:00100000:1.0:1789760756.554311:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263616 00000100:00100000:1.0:1789760756.554355:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760756.554363:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edc10b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083263616:12345-0@lo:400: 00000100:00100000:1.0:1789760756.554478:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edc10b4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083263616:12345-0@lo:400: Request processed in 114us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.554486:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:1.0:1789760756.554534:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760756.554538:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554540:0:7234:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789760756.554543:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760756.554548:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554549:0:7234:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789760756.554553:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789760756.554581:0:7234:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789760756.554592:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760756.554595:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554596:0:7234:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789760756.554599:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789760756.554600:0:7234:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789760756.554602:0:7234:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789760756.554603:0:7234:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789760756.554605:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789760756.554607:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554608:0:7234:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789760756.554610:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760756.554612:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554613:0:7234:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760756.554615:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760756.554616:0:7234:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:3.0:1789760756.554631:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e561e8c x1876700083263616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760756.554644:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e561e8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083263616:0@lo:400: 00000020:01000000:1.0:1789760756.554702:0:7234:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760756.554706:0:7234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760756.554707:0:7234:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760756.554714:0:7234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1789760756.554818:0:7226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:0.0:1789760756.554822:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263488 00000100:00100000:0.0:1789760756.554827:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263488 10000000:01000000:2.0:1789760756.554857:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:0.0:1789760756.554861:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789760756.554865:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074d2bf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3427:x1876700083263488:12345-0@lo:38: 00010000:00010000:2.0:1789760756.554873:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.554883:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000073c64a13/0x838c7b3c022b72fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1789760756.554886:0:6434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 10000000:01000000:2.0:1789760756.554892:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933099616800 from 1 10000000:01000000:2.0:1789760756.554895:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000080:0.0:1789760756.554916:0:6434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b734f 00010000:00010000:2.0:1789760756.554919:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.554925:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:0.0:1789760756.554931:0:6434:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:2.0:1789760756.554933:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789760756.554936:0:6434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789760756.554946:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf99272f pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263744:0@lo:101: 00000100:00100000:2.0:1789760756.554984:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.555000:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000918770a1 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.555103:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263744 00000100:00100000:3.0:1789760756.555108:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263744 00000100:00100000:0.0:1789760756.555332:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760756.555341:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076120838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+12:7226:x1876700083263744:12345-0@lo:101: 00010000:00010000:0.0:1789760756.555352:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760756.555365:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7356 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.555387:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 13 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.555399:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 13 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.555408:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007137b417, rc 0) 00000100:00100000:0.0:1789760756.555479:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076120838 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083263744:12345-0@lo:101: Request processed in 140us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.555485:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760756.555544:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf99272f pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263744:0@lo:101: 00010000:00010000:3.0:1789760756.555559:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.555577:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.556100:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263872:0@lo:256: 00000100:00100000:3.0:1789760756.556141:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.557657:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cc3b9a going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.557699:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083263872 00000100:00100000:0.0:1789760756.557709:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083263872 00000100:00100000:0.0:1789760756.557801:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760756.557810:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf1b087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083263872:12345-0@lo:256: 20000000:01000000:0.0:1789760756.557832:0:6425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789760756.557909:0:6425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789760756.557913:0:6425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789760756.558013:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf1b087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083263872:12345-0@lo:256: Request processed in 204us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.558021:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789760756.558091:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083263872:0@lo:256: 10000000:01000000:3.0:1789760756.558798:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760756.558814:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.558826:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760756.558834:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933099616800 from 1 10000000:01000000:3.0:1789760756.558837:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789760756.558884:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.558892:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.558901:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.558920:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264000:0@lo:101: 00000100:00100000:3.0:1789760756.558962:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.558999:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cc3b9a going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.559021:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264000 00000100:00100000:3.0:1789760756.559029:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264000 00000100:00100000:3.0:1789760756.559059:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760756.559067:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000601bd1eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083264000:12345-0@lo:101: 00010000:00010000:3.0:1789760756.559079:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760756.559092:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7364 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.559120:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 14 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.559132:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 14 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.559144:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a21f445a, rc 0) 00000100:00100000:3.0:1789760756.559177:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000601bd1eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264000:12345-0@lo:101: Request processed in 111us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.559217:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760756.559262:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264000:0@lo:101: 00010000:00010000:3.0:1789760756.559276:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.559285:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.559498:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264128:0@lo:501: 00000100:00100000:3.0:1789760756.559525:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.559539:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cc3b9a going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.559558:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264128 00000100:00100000:3.0:1789760756.559561:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264128 00000100:00100000:3.0:1789760756.559584:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760756.559590:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ead82348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264128:12345-0@lo:501: 00000100:00100000:3.0:1789760756.559725:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ead82348 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264128:12345-0@lo:501: Request processed in 135us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.559733:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760756.559765:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264128:0@lo:501: 00000100:00100000:3.0:1789760756.559792:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264256:0@lo:503: 00000100:00100000:3.0:1789760756.559829:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.559846:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cc3b9a going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.559871:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264256 00000100:00100000:3.0:1789760756.559875:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264256 00000100:00100000:3.0:1789760756.559891:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789760756.559896:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000204967b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264256:12345-0@lo:503: 00000040:00080000:3.0:1789760756.559927:0:6422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789760756.559964:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000204967b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264256:12345-0@lo:503: Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.560384:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789760756.560428:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264256:0@lo:503: 00000040:00080000:3.0:1789760756.561025:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789760756.561061:0:7226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789760756.561117:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760756.562154:0:7240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1789760756.562434:0:7226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789760756.562454:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760756.562472:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.562484:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.562526:0:7226:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789760756.562529:0:7226:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933099616800 10000000:01000000:2.0:1789760756.562532:0:7226:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933099616800 10000000:01000000:2.0:1789760756.562537:0:7226:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789760756.562542:0:7226:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933099616800 from 1 10000000:01000000:2.0:1789760756.562545:0:7226:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789760756.562581:0:7226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.562589:0:7226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.562606:0:7226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.562627:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000792b408a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264384:0@lo:101: 00000100:00100000:2.0:1789760756.562683:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.562726:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c75269e7 going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.562897:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264384 00000100:00100000:1.0:1789760756.562905:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264384 00000100:00100000:1.0:1789760756.562953:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760756.562961:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007099692b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:7226:x1876700083264384:12345-0@lo:101: 00010000:00010000:1.0:1789760756.562977:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760756.562988:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc61142d/0x838c7b3c022b7379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7372 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.563013:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc61142d/0x838c7b3c022b7379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.563023:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc61142d/0x838c7b3c022b7379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760756.563031:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc61142d, rc 0) 00000100:00100000:1.0:1789760756.563075:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007099692b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264384:12345-0@lo:101: Request processed in 114us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.563082:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789760756.563155:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000792b408a pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264384:0@lo:101: 00010000:00010000:2.0:1789760756.563276:0:7226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.563291:0:7226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.563465:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264512:0@lo:501: 00000100:00100000:1.0:1789760756.563490:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.563550:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005dbc8fb going to sleep for 11 seconds 00000100:00100000:2.0:1789760756.563578:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264512 00000100:00100000:2.0:1789760756.563582:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264512 00000100:00100000:2.0:1789760756.563632:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789760756.563638:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e730b7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264512:12345-0@lo:501: 00000100:00100000:2.0:1789760756.563789:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e730b7f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264512:12345-0@lo:501: Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.563797:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789760756.563989:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264512:0@lo:501: 00000100:00100000:1.0:1789760756.564015:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264640:0@lo:503: 00000100:00100000:1.0:1789760756.564049:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.564064:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005dbc8fb going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.564077:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264640 00000100:00100000:1.0:1789760756.564086:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264640 00000100:00100000:1.0:1789760756.564106:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760756.564111:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a072690e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264640:12345-0@lo:503: 00000100:00100000:1.0:1789760756.564292:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a072690e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264640:12345-0@lo:503: Request processed in 180us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.564298:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789760756.564339:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264640:0@lo:503: 00000040:00080000:1.0:1789760756.564566:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760756.564627:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264768:0@lo:502: 00000100:00100000:1.0:1789760756.564661:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.565358:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264768 00000100:00100000:1.0:1789760756.565363:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005dbc8fb going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.565366:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264768 00000100:00100000:2.0:1789760756.565433:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789760756.565442:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ed3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264768:12345-0@lo:502: 00000100:00100000:2.0:1789760756.565648:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ed3f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264768:12345-0@lo:502: Request processed in 207us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.565656:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789760756.565978:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264768:0@lo:502: 00000040:00080000:1.0:1789760756.566285:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789760756.566335:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789760756.566370:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789760756.566426:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789760756.566464:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789760756.566512:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789760756.566543:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789760756.566576:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789760756.566625:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789760756.566662:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789760756.566698:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789760756.566752:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789760756.566788:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789760756.566824:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789760756.566910:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789760756.566948:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789760756.566993:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789760756.567050:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789760756.567087:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789760756.567122:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789760756.567173:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789760756.567263:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789760756.567299:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789760756.567349:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789760756.567385:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789760756.567415:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789760756.567472:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789760756.567511:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789760756.567554:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264896:0@lo:502: 00000100:00100000:1.0:1789760756.567615:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.567698:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005dbc8fb going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.567736:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083264896 00000100:00100000:0.0:1789760756.567744:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083264896 00000100:00100000:0.0:1789760756.567817:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789760756.567827:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdede8b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264896:12345-0@lo:502: 00000100:00100000:0.0:1789760756.568033:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdede8b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083264896:12345-0@lo:502: Request processed in 207us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.568041:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760756.568603:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ceb20d8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083264896:0@lo:502: 00000040:00080000:2.0:1789760756.568693:0:7226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789760756.568705:0:7226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789760756.571517:0:7241:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789760756.571532:0:7241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000402832bf) 00000020:00000080:2.0:1789760756.571553:0:7241:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1789760756.571620:0:7241:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f64386eb from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789760756.571623:0:7241:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f64386eb from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789760756.571626:0:7241:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f64386eb 3 00010000:00080000:2.0:1789760756.571656:0:7241:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ad363603@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.153@tcp at head 00010000:00010000:2.0:1789760756.573649:0:7241:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789760756.574005:0:7241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789760756.574041:0:7241:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789760756.574064:0:7241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x838c7b3c022b7387 00000100:00080000:2.0:1789760756.574075:0:7241:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789760756.574079:0:7241:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000ad363603 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1789760756.574120:0:7241:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000792b408a x1876700083265024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789760756.574153:0:7241:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789760756.574415:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000792b408a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3427:1876700083265024:0@lo:38: 00000100:00100000:0.0:1789760756.574490:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789760756.574924:0:7241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789760756.575052:0:7242:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1789760756.575151:0:7226:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:1.0:1789760756.575522:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265024 00000100:00100000:1.0:1789760756.575534:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265024 00000100:00100000:1.0:1789760756.575571:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.575579:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a77ffece pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3427:x1876700083265024:12345-0@lo:38: 00010000:00080000:1.0:1789760756.575607:0:6431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:1.0:1789760756.575639:0:6431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x838c7b3c022b738e 00000004:00100000:1.0:1789760756.575656:0:6431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789760756.575688:0:6431:0:(import.c:65:import_set_state_nolock()) 00000000885ddd9d : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760756.575769:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a77ffece pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3427:x1876700083265024:12345-0@lo:38: Request processed in 189us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.575777:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789760756.575825:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000792b408a x1876700083265024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760756.575837:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760756.575846:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789760756.575870:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789760756.575874:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760756.575877:0:3427:0:(import.c:65:import_set_state_nolock()) 00000000ad363603 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760756.575883:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000792b408a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3427:1876700083265024:0@lo:38: 10000000:01000000:3.0:1789760756.576264:0:7226:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760756.576317:0:7226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.576335:0:7226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000003f8b01fb/0x838c7b3c022b7372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789760756.578272:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789760756.578277:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789760756.578278:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760756.578280:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760756.578281:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760756.578283:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760756.578287:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760756.578288:0:7226:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760756.578290:0:7226:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760756.578291:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760756.578292:0:7226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760756.578297:0:7226:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1789760756.578301:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760756.578302:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789760756.578304:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760756.578305:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760756.578306:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760756.578307:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760756.578308:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789760756.578309:0:7226:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760756.578310:0:7226:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760756.578311:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760756.578311:0:7226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760756.578467:0:7226:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789760756.578487:0:7226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083265152:0@lo:253: 00000100:00100000:1.0:1789760756.578563:0:7226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.578604:0:7226:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f1849b going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.578632:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265152 00000100:00100000:1.0:1789760756.578651:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265152 00000100:00100000:1.0:1789760756.578826:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789760756.578838:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003501b37f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:7226:x1876700083265152:12345-0@lo:253: 20000000:01000000:1.0:1789760756.578897:0:6424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789760756.578910:0:6424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1789760756.580298:0:6434:0:(import.c:65:import_set_state_nolock()) 000000006633eb83 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760756.580403:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074d2bf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3427:x1876700083263488:12345-0@lo:38: Request processed in 25534us (26388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.580415:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760756.580427:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789760756.580439:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789760756.580448:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789760756.580455:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789760756.580458:0:3427:0:(import.c:65:import_set_state_nolock()) 00000000935d9507 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789760756.580476:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083263488:0@lo:38: 00000100:00100000:1.0:1789760756.580686:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070037922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083265280:0@lo:41: 00000100:00100000:1.0:1789760756.580732:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.580755:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265280 00000100:00100000:0.0:1789760756.580763:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265280 00000100:00100000:0.0:1789760756.580804:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760756.580813:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abd22240 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3430:x1876700083265280:12345-0@lo:41: 00000004:00000024:0.0:1789760756.580846:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760756.580923:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abd22240 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3430:x1876700083265280:12345-0@lo:41: Request processed in 112us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.580930:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789760756.580949:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070037922 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083265280:0@lo:41: 00000001:00100000:1.0:1789760756.598014:0:6451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789760756.598114:0:6424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789760756.598152:0:6424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789760756.599077:0:6445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789760756.599084:0:6445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789760756.599106:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.599128:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.599135:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 15 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.599141:0:6445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.600066:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 15 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.600084:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 15 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.600099:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083265408:0@lo:104: 00000100:00100000:3.0:1789760756.600362:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789760756.600459:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.600467:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760756.600491:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004be92841 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083265536:0@lo:104: 00000100:00100000:3.0:1789760756.600515:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760756.600817:0:6445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a50656c4 going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.601075:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265408 00000100:00100000:0.0:1789760756.601085:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265408 00000100:00100000:0.0:1789760756.601132:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265536 00000100:00100000:0.0:1789760756.601135:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265536 00000100:00100000:0.0:1789760756.601151:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760756.601159:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056434ea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083265408:12345-0@lo:104: 00010000:00010000:0.0:1789760756.601174:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.601301:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760756.601307:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056434ea2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083265408:12345-0@lo:104: Request processed in 149us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.601315:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760756.601333:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760756.601339:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dde5e35d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083265536:12345-0@lo:104: 00010000:00010000:0.0:1789760756.601346:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760756.601379:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789760756.601384:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dde5e35d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083265536:12345-0@lo:104: Request processed in 46us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760756.601391:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760756.601541:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc713b75 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083265408:0@lo:104: 00000100:00100000:2.0:1789760756.601552:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004be92841 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083265536:0@lo:104: 00010000:00010000:2.0:1789760756.601577:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601596:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760756.601602:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601620:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000754d2854 already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760756.601630:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601638:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760756.601644:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.601649:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760756.601697:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601703:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760756.601718:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601723:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 00000000754d2854/0x838c7b3c022b7356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b735d expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601735:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760756.601737:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601742:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a624207 already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760756.601744:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601749:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760756.601764:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760756.601769:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760756.601781:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601786:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760756.601799:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601804:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000009a624207/0x838c7b3c022b72ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b72b5 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601819:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760756.601820:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760756.601822:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760756.601830:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760756.601841:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083265664:0@lo:103: 00010000:00010000:1.0:1789760756.601876:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760756.601884:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.601890:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc3a0bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083265792:0@lo:103: 00000100:00100000:1.0:1789760756.601916:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.601918:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265664 00000100:00100000:2.0:1789760756.601922:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265664 00010000:00010000:2.0:1789760756.601939:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 16 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760756.601943:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265792 00000100:00100000:1.0:1789760756.601946:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265792 00010000:00010000:1.0:1789760756.601958:0:6415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 17 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.601958:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760756.601964:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a81c9a01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+17:3430:x1876700083265664:12345-0@lo:103: 00000100:00100000:1.0:1789760756.601970:0:6415:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789760756.601974:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789760756.601976:0:6415:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789760756.601978:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 17 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.601993:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 17 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602006:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007137b417/0x838c7b3c022b735d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7356 expref: 17 pid: 6425 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602020:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760756.602047:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a81c9a01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+16:3430:x1876700083265664:12345-0@lo:103: Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.602053:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760756.602065:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760756.602071:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a17a1390 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+15:3428:x1876700083265792:12345-0@lo:103: 00010000:00010000:2.0:1789760756.602078:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760756.602081:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602089:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602099:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054df97f2/0x838c7b3c022b72b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b72ae expref: 15 pid: 6424 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602109:0:6417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602121:0:6417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760756.602135:0:6417:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003052623s 00010000:00010000:2.0:1789760756.602145:0:6417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602153:0:6417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602160:0:6417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602165:0:6417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602170:0:6417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4e98385 already unused, calling callback (00000000d208beed) 00010000:00010000:2.0:1789760756.602173:0:6417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602199:0:6417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602213:0:6417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760756.602224:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789760756.602235:0:6445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.602247:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760756.602253:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4e98385/0x838c7b3c022b7395 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760756.602262:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a17a1390 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+14:3428:x1876700083265792:12345-0@lo:103: Request processed in 190us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.602269:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760756.602321:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083265664:0@lo:103: 00000100:00100000:1.0:1789760756.602729:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc3a0bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083265792:0@lo:103: 00000100:00100000:0.0:1789760756.605634:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003501b37f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+13:7226:x1876700083265152:12345-0@lo:253: Request processed in 26792us (27066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.605668:0:7226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:7226:1876700083265152:0@lo:253: 10000000:01000000:1.0:1789760756.605686:0:7226:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789760756.605692:0:7226:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760756.605695:0:7226:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789760756.605697:0:7226:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760756.605698:0:7226:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760756.605700:0:7226:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760756.605701:0:7226:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760756.605703:0:7226:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:0.0:1789760756.605706:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000020:01000004:1.0:1789760756.605707:0:7226:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760756.605710:0:7226:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760756.605713:0:7226:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760756.605714:0:7226:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789760756.605737:0:7226:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760756.613104:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.613413:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760756.613624:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.613809:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760756.614021:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.614215:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760756.615470:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.615722:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760756.615993:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.616877:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760756.617515:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x9:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760756.617686:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:2.0:1789760756.622653:0:7226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789760756.622674:0:7247:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789760756.622681:0:7247:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789760756.624456:0:7248:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789760756.624457:0:7226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789760756.624523:0:7248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7248:1876700083265920:0@lo:700: 00000100:00100000:2.0:1789760756.624599:0:7248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760756.624648:0:7248:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db1a4d14 going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.625294:0:6436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083265920 00000100:00100000:3.0:1789760756.625304:0:6436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083265920 00000100:00100000:3.0:1789760756.625355:0:6436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760756.625374:0:6436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d42c174e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7248:x1876700083265920:12345-0@lo:700: 00000100:00100000:0.0:1789760756.625730:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266048:0@lo:1000: 00000100:00100000:0.0:1789760756.625775:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.625815:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b673259b going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.625968:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266048 00000100:00100000:1.0:1789760756.625978:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266048 00000100:00100000:1.0:1789760756.626018:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.626024:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebbc8d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266048:12345-0@lo:1000: 00000100:00100000:1.0:1789760756.626101:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebbc8d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266048:12345-0@lo:1000: Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.626109:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760756.626152:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266048:0@lo:1000: 00000040:01000000:1.0:1789760756.626211:0:7249:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789760756.626254:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266176:0@lo:700: 00000100:00100000:1.0:1789760756.626282:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.626307:0:6438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266176 00000100:00100000:1.0:1789760756.626311:0:6438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266176 00000100:00100000:1.0:1789760756.626351:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760756.626357:0:6438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1d9f415 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266176:12345-0@lo:700: 00000100:00100000:1.0:1789760756.626390:0:6438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1d9f415 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266176:12345-0@lo:700: Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.626396:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760756.626413:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f1849b going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.626425:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266176:0@lo:700: 00000100:00100000:1.0:1789760756.626467:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7249:1876700083266304:0@lo:900: 00000100:00100000:1.0:1789760756.626492:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.626522:0:6440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266304 00000100:00100000:1.0:1789760756.626526:0:6440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266304 00000100:00100000:1.0:1789760756.626553:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760756.626560:0:6440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5cd4260 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7249:x1876700083266304:12345-0@lo:900: 00000100:00100000:1.0:1789760756.626593:0:6440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5cd4260 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7249:x1876700083266304:12345-0@lo:900: Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.626606:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760756.626638:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056f1849b going to sleep for 11 seconds 00010000:00080000:1.0:1789760756.626658:0:7249:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0706fbd x1876700083266304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760756.626669:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7249:1876700083266304:0@lo:900: 00000100:00100000:1.0:1789760756.626746:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266432:0@lo:1000: 00000100:00100000:1.0:1789760756.626776:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.626795:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266432 00000100:00100000:1.0:1789760756.626799:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266432 00000100:00100000:1.0:1789760756.626820:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760756.626827:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eccbb68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266432:12345-0@lo:1000: 00000100:00100000:1.0:1789760756.626890:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eccbb68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266432:12345-0@lo:1000: Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760756.626897:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760756.626915:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 00000000217f4b4a going to sleep for 11 seconds 00000100:00100000:1.0:1789760756.626930:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266432:0@lo:1000: 00000004:00080000:1.0:1789760756.626971:0:7249:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000056f1849b with version 0 00000020:00100000:1.0:1789760756.626987:0:7249:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789760756.626993:0:7249:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b0706fbd x1876700083266688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:2.0:1789760756.627004:0:7226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789760756.627007:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266688:0@lo:1000: 00000100:00100000:1.0:1789760756.627036:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.627056:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266688 00000100:00100000:1.0:1789760756.627060:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266688 00000100:00100000:1.0:1789760756.627082:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760756.627096:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c05b070 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7249:x1876700083266688:12345-0@lo:1000: 00000040:00080000:2.0:1789760756.627216:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789760756.627682:0:7226:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789760756.627691:0:7226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789760756.627918:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760756.627976:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b3648e6 going to sleep for 11 seconds 00000040:00080000:2.0:1789760756.628924:0:7226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789760756.629475:0:7226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789760756.629505:0:7226:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789760756.629755:0:7226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789760756.632149:0:7226:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00100000:10000000:2.0:1789760756.633947:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789760756.634129:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789760756.634423:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789760756.634822:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789760756.635323:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789760756.635524:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789760756.635843:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789760756.636133:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789760756.636339:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789760756.636539:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789760756.636957:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789760756.637232:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789760756.637405:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789760756.637739:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789760756.638051:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789760756.638302:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789760756.638828:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789760756.639139:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789760756.639388:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789760756.639773:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789760756.640073:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789760756.640341:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789760756.640482:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789760756.640655:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789760756.640812:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789760756.641125:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789760756.641301:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789760756.641446:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789760756.641603:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789760756.641769:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789760756.642096:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789760756.642326:0:7226:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789760756.642456:0:7226:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 40000000:02000000:2.0:1789760756.670938:0:6436:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1789760756.671643:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c05b070 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7249:x1876700083266688:12345-0@lo:1000: Request processed in 44545us (44602us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789760756.671659:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760756.671738:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0706fbd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266688:0@lo:1000: 00000100:00100000:1.0:1789760756.671822:0:7249:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266816:0@lo:1000: 00000100:00100000:1.0:1789760756.671881:0:7249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760756.671921:0:7249:0:(client.c:2715:ptlrpc_set_wait()) set 000000008414803e going to sleep for 11 seconds 00000100:00100000:3.0:1789760756.674091:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083266816 00000100:00100000:3.0:1789760756.674106:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083266816 00000100:00100000:3.0:1789760756.674827:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760756.674838:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ceb20d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7249:x1876700083266816:12345-0@lo:1000: 00000100:00100000:3.0:1789760756.674985:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ceb20d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7249:x1876700083266816:12345-0@lo:1000: Request processed in 148us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760756.674993:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760756.675246:0:7249:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058bf1e2b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7249:1876700083266816:0@lo:1000: 00000040:00080000:3.0:1789760756.675279:0:7249:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789760756.675329:0:7249:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000283bb4d0 with version 1 00000040:00080000:3.0:1789760756.678278:0:7249:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789760756.678360:0:7249:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789760756.678447:0:7238:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000422d86d9 version 1 rpc_version 1 00000020:00100000:3.0:1789760756.678487:0:7238:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789760756.678498:0:7238:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001e727880 x1876700083267072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789760756.678522:0:7238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e727880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7238:1876700083267072:0@lo:1000: 00000001:00080000:2.0:1789760756.678826:0:6451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789760756.678913:0:6436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d42c174e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7248:x1876700083265920:12345-0@lo:700: Request processed in 53539us (54313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760756.678930:0:6436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789760756.678985:0:7248:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001334896c x1876700083265920/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760772 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760756.679001:0:7248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7248:1876700083265920:0@lo:700: 40000000:02000000:2.0:1789760756.679016:0:7248:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1789760756.681069:0:7238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760756.681369:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267072 00000100:00100000:3.0:1789760756.681376:0:7238:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cc3b9a going to sleep for 11 seconds 00000100:00100000:0.0:1789760756.681383:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267072 00000100:00100000:0.0:1789760756.681597:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789760756.681610:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1125324 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7238:x1876700083267072:12345-0@lo:1000: 00000001:00080000:2.0:1789760756.733131:0:6451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789760756.733453:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1125324 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7238:x1876700083267072:12345-0@lo:1000: Request processed in 51842us (52386us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789760756.733468:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789760756.733552:0:7238:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789760756.733558:0:7238:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000004:00080000:2.0:1789760756.733562:0:7238:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967298 00000100:00100000:2.0:1789760756.733599:0:7238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e727880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7238:1876700083267072:0@lo:1000: 00000001:00080000:2.0:1789760756.739625:0:7226:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789760756.739664:0:7226:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbc8941c83988 00100000:10000000:2.0:1789760756.739673:0:7226:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789760756.743242:0:7226:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789760756.743286:0:7226:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789760756.743299:0:7226:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789760756.743316:0:7226:0:(super25.c:182:lustre_fill_super()) lustre-mdt2/mdt2: Mount complete 00000040:00080000:0.0:1789760756.863374:0:7248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760756.959453:0:7248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789760756.959531:0:7248:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789760756.959536:0:7248:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789760757.062573:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760758.088060:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789760758.278377:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789760758.278385:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933099616800 from 4 10000000:01000000:2.0:1789760758.278390:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760758.278442:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.278457:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.278470:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.278493:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267200:0@lo:101: 00000100:00100000:2.0:1789760758.278637:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.278690:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000003c639048 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.278697:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267200 00000100:00100000:0.0:1789760758.278707:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267200 00000100:00100000:2.0:1789760758.278912:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789760758.278930:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a09b795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+13:6427:x1876700083267200:12345-0@lo:101: 00010000:00010000:2.0:1789760758.278947:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.278960:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008769778a/0x838c7b3c022b73a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b739c expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.278987:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008769778a/0x838c7b3c022b73a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b739c expref: 14 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.278998:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008769778a/0x838c7b3c022b73a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b739c expref: 14 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.279008:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008769778a, rc 0) 00000100:00100000:2.0:1789760758.279073:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a09b795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:6427:x1876700083267200:12345-0@lo:101: Request processed in 129us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.279081:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789760758.279090:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001334896c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267200:0@lo:101: 00010000:00010000:0.0:1789760758.279108:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.279124:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.279334:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267328:0@lo:256: 00000100:00100000:0.0:1789760758.279374:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.279400:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb876be6 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.279469:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267328 00000100:00100000:1.0:1789760758.279474:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267328 00000100:00100000:1.0:1789760758.279508:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789760758.279514:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bb64b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:6427:x1876700083267328:12345-0@lo:256: 20000000:01000000:1.0:1789760758.279528:0:6424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760758.279543:0:6424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760758.279546:0:6424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789760758.279633:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bb64b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:6427:x1876700083267328:12345-0@lo:256: Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.279641:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789760758.279767:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267328:0@lo:256: 10000000:01000000:3.0:1789760758.279812:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760758.279819:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.279828:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000002a00d6ed/0x838c7b3c022b739c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760758.279850:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760758.279853:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933087a7b000 from 21 10000000:01000000:3.0:1789760758.279855:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760758.279875:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.279883:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.279890:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.279916:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e79f45f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267456:0@lo:101: 00000100:00100000:3.0:1789760758.279943:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760758.279956:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000064b937e going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.280005:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267456 00000100:00100000:1.0:1789760758.280009:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267456 00000100:00100000:1.0:1789760758.280102:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789760758.280109:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000879b5443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:6427:x1876700083267456:12345-0@lo:101: 00010000:00010000:1.0:1789760758.280117:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760758.280126:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052b0b2c1/0x838c7b3c022b73b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b73aa expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.280144:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052b0b2c1/0x838c7b3c022b73b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.280153:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052b0b2c1/0x838c7b3c022b73b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.280160:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052b0b2c1, rc 0) 00000100:00100000:1.0:1789760758.280216:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000879b5443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083267456:12345-0@lo:101: Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.280222:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789760758.280309:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e79f45f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267456:0@lo:101: 00010000:00010000:0.0:1789760758.280321:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.280329:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760758.280379:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267584:0@lo:501: 00000100:00100000:0.0:1789760758.280403:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.280424:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d0d6fe2 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.280436:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267584 00000100:00100000:0.0:1789760758.280439:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267584 00000100:00100000:0.0:1789760758.280460:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789760758.280467:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a39e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083267584:12345-0@lo:501: 00000100:00100000:0.0:1789760758.280776:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a39e839 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083267584:12345-0@lo:501: Request processed in 310us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.280784:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789760758.280808:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267584:0@lo:501: 00000100:00100000:0.0:1789760758.280831:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267712:0@lo:503: 00000100:00100000:0.0:1789760758.280877:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.280889:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d0d6fe2 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.280899:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267712 00000100:00100000:0.0:1789760758.280901:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267712 00000100:00100000:0.0:1789760758.280916:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789760758.280922:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000566bcf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083267712:12345-0@lo:503: 00000100:00100000:0.0:1789760758.281118:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000566bcf65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083267712:12345-0@lo:503: Request processed in 197us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.281125:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789760758.281154:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083267712:0@lo:503: 00000100:00100000:0.0:1789760758.281755:0:7334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7334:1876700083267840:0@lo:502: 00000100:00100000:0.0:1789760758.281792:0:7334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.281860:0:7334:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d90492e1 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.281890:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267840 00000100:00100000:1.0:1789760758.281894:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267840 00000100:00100000:1.0:1789760758.281949:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789760758.281955:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e610345 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:7334:x1876700083267840:12345-0@lo:502: 00000100:00100000:1.0:1789760758.282212:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e610345 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:7334:x1876700083267840:12345-0@lo:502: Request processed in 257us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.282220:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789760758.282477:0:7334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7334:1876700083267840:0@lo:502: 00000100:00100000:0.0:1789760758.282526:0:7334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7334:1876700083267968:0@lo:502: 00000100:00100000:0.0:1789760758.282558:0:7334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.282581:0:7334:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d90492e1 going to sleep for 11 seconds 00000100:00100000:3.0:1789760758.282642:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083267968 00000100:00100000:3.0:1789760758.282648:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083267968 00000100:00100000:3.0:1789760758.282680:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789760758.282687:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e184d4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7334:x1876700083267968:12345-0@lo:502: 00000100:00100000:3.0:1789760758.282832:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e184d4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:7334:x1876700083267968:12345-0@lo:502: Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.282851:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789760758.282924:0:7334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7334:1876700083267968:0@lo:502: 00000040:00080000:0.0:1789760758.282950:0:7334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789760758.283099:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789760758.283115:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760758.283123:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.283133:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 0000000012bce0de/0x838c7b3c022b73aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760758.283143:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789760758.283145:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933087a7b000 from 4 10000000:01000000:3.0:1789760758.283147:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789760758.283169:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.283177:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760758.283210:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760758.283229:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028b1671f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268096:0@lo:101: 00000100:00100000:3.0:1789760758.283252:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760758.283267:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000002c5081a7 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.283369:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268096 00000100:00100000:0.0:1789760758.283374:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268096 00000100:00100000:0.0:1789760758.283400:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789760758.283414:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb6e706c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083268096:12345-0@lo:101: 00010000:00010000:0.0:1789760758.283423:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.283434:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000982d6c60/0x838c7b3c022b73bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b73b8 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.283464:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000982d6c60/0x838c7b3c022b73bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.283474:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000982d6c60/0x838c7b3c022b73bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.283482:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000982d6c60, rc 0) 00000100:00100000:0.0:1789760758.283518:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb6e706c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083268096:12345-0@lo:101: Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.283524:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789760758.283603:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028b1671f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268096:0@lo:101: 00010000:00010000:2.0:1789760758.283616:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.283626:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.283672:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268224:0@lo:256: 00000100:00100000:2.0:1789760758.283705:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.283728:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f595dbb3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760758.283740:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268224 00000100:00100000:2.0:1789760758.283743:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268224 00000100:00100000:2.0:1789760758.283767:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760758.283772:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d920374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083268224:12345-0@lo:256: 20000000:01000000:2.0:1789760758.283793:0:6424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760758.283805:0:6424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760758.283808:0:6424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789760758.283897:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d920374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083268224:12345-0@lo:256: Request processed in 124us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.283904:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789760758.283941:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268224:0@lo:256: 10000000:01000000:2.0:1789760758.283987:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789760758.283992:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.283999:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000f4e98385/0x838c7b3c022b73b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760758.284006:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789760758.284008:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789760758.284010:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789760758.284025:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284030:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284038:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.284049:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268352:0@lo:101: 00000100:00100000:2.0:1789760758.284075:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.284090:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f595dbb3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760758.284260:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268352 00000100:00100000:2.0:1789760758.284265:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268352 00000100:00100000:2.0:1789760758.284293:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760758.284300:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4bc102d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083268352:12345-0@lo:101: 00010000:00010000:2.0:1789760758.284307:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760758.284315:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000026743dcd/0x838c7b3c022b73cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b73c6 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284329:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026743dcd/0x838c7b3c022b73cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284336:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000026743dcd/0x838c7b3c022b73cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284343:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000026743dcd, rc 0) 00000100:00100000:2.0:1789760758.284370:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4bc102d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083268352:12345-0@lo:101: Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.284376:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789760758.284408:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268352:0@lo:101: 00010000:00010000:2.0:1789760758.284418:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760758.284424:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760758.284467:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268480:0@lo:501: 00000100:00100000:2.0:1789760758.284491:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.284508:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f595dbb3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760758.284630:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268480 00000100:00100000:2.0:1789760758.284641:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268480 00000100:00100000:2.0:1789760758.284663:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789760758.284668:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a37b07be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083268480:12345-0@lo:501: 00000100:00100000:2.0:1789760758.284917:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a37b07be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083268480:12345-0@lo:501: Request processed in 249us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.284924:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789760758.284951:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268480:0@lo:501: 00000100:00100000:2.0:1789760758.284981:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268608:0@lo:503: 00000100:00100000:2.0:1789760758.285021:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.285037:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f595dbb3 going to sleep for 11 seconds 00000100:00100000:2.0:1789760758.285050:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268608 00000100:00100000:2.0:1789760758.285053:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268608 00000100:00100000:2.0:1789760758.285072:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789760758.285077:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eef807f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083268608:12345-0@lo:503: 00000100:00100000:2.0:1789760758.285675:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eef807f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083268608:12345-0@lo:503: Request processed in 596us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760758.285684:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789760758.285792:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083268608:0@lo:503: 00000100:00100000:3.0:1789760758.286979:0:7336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000478383d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7336:1876700083268736:0@lo:502: 00000100:00100000:3.0:1789760758.287106:0:7336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760758.287203:0:7336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e52c950c going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.287282:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268736 00000100:00100000:0.0:1789760758.287289:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268736 00000100:00100000:0.0:1789760758.287370:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789760758.287379:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b5bae95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:7336:x1876700083268736:12345-0@lo:502: 00000100:00100000:0.0:1789760758.287694:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b5bae95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:7336:x1876700083268736:12345-0@lo:502: Request processed in 316us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.287702:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789760758.287778:0:7336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000478383d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7336:1876700083268736:0@lo:502: 00000020:01000000:3.0:1789760758.287806:0:7336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760758.287816:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760758.287818:0:7336:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789760758.287822:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760758.287825:0:7336:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:00000080:3.0:1789760758.287859:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760758.287883:0:7336:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000004c07bdec) 00000020:00000080:3.0:1789760758.287903:0:7336:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789760758.287909:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760758.287977:0:7336:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789760758.287983:0:7336:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789760758.287988:0:7336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b73db 00010000:00080000:3.0:1789760758.288035:0:7336:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dcacff52@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:3.0:1789760758.289638:0:7336:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789760758.291588:0:7336:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789760758.291601:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789760758.291627:0:7336:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789760758.291647:0:7336:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b73e2 00000100:00080000:0.0:1789760758.291660:0:7336:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760758.291665:0:7336:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000dcacff52 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760758.291707:0:7336:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007e9fb6bc x1876700083268864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760758.291734:0:7336:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789760758.291765:0:7336:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789760758.291873:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083268864:0@lo:38: 00000100:00100000:2.0:1789760758.291950:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.292039:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268864 00000100:00100000:1.0:1789760758.292048:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268864 00000100:00100000:1.0:1789760758.292084:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789760758.292093:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a81c9a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3427:x1876700083268864:12345-0@lo:38: 00010000:00080000:1.0:1789760758.292120:0:6434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1789760758.292159:0:6434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b73e9 00000004:00100000:1.0:1789760758.292175:0:6434:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789760758.292200:0:6434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789760758.292338:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083268992:0@lo:400: 00000100:00100000:2.0:1789760758.292374:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.292409:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a080010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083269120:0@lo:400: 00000100:00100000:1.0:1789760758.292456:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e06183a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083269248:0@lo:400: 00000100:00100000:1.0:1789760758.292501:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760758.292676:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.292786:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083268992 00000100:00100000:1.0:1789760758.292792:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083268992 00000100:00100000:1.0:1789760758.292827:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269248 00000100:00100000:1.0:1789760758.292830:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269248 00000100:00100000:1.0:1789760758.292858:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760758.292863:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b701a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083268992:12345-0@lo:400: 00000100:00100000:1.0:1789760758.292923:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b701a21 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083268992:12345-0@lo:400: Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.292930:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760758.292945:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760758.292951:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e561e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083269248:12345-0@lo:400: 00000100:00100000:1.0:1789760758.292982:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e561e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083269248:12345-0@lo:400: Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.292988:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760758.293037:0:6435:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789760758.293045:0:6435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:1.0:1789760758.293078:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000e06183a x1876700083269248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760758.293092:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e06183a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083269248:0@lo:400: 00010000:00080000:1.0:1789760758.293472:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f0fe2e0a x1876700083268992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760758.293682:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083268992:0@lo:400: 00000100:00080000:3.0:1789760758.293828:0:7340:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000478383d1 x1876700083269376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760758.293847:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e823d782 going to sleep for 0 seconds 00000020:01000000:0.0:1789760758.293931:0:7336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760758.293937:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760758.293939:0:7336:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789760758.293942:0:7336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760758.293946:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760758.293947:0:7336:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760758.293950:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760758.293952:0:7336:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760758.293974:0:7336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7336:1876700083269504:0@lo:502: 00000100:00100000:0.0:1789760758.295003:0:7336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.295038:0:7336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000babb7407 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.295132:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269504 00000100:00100000:1.0:1789760758.295141:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269504 00000100:00100000:1.0:1789760758.295203:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789760758.295211:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3311bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:7336:x1876700083269504:12345-0@lo:502: 00000100:00100000:1.0:1789760758.295731:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269120 00000100:00100000:1.0:1789760758.295737:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269120 00000100:00100000:3.0:1789760758.295923:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760758.295936:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003b9fde5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083269120:12345-0@lo:400: 00000100:00100000:1.0:1789760758.295951:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3311bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:7336:x1876700083269504:12345-0@lo:502: Request processed in 742us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.295960:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789760758.295989:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003b9fde5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083269120:12345-0@lo:400: Request processed in 55us (3313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760758.295995:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760758.296250:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a080010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083269120:0@lo:400: 00000100:00100000:0.0:1789760758.296560:0:7336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7336:1876700083269504:0@lo:502: 00000020:01000000:0.0:1789760758.296589:0:7336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760758.296594:0:7336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760758.296597:0:7336:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760758.296600:0:7336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789760758.296773:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789760758.296796:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760758.296807:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.296818:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 00000000a11f9c18/0x838c7b3c022b73c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760758.296828:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789760758.296830:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93309ea30000 from 1 10000000:01000000:1.0:1789760758.296833:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760758.296878:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.296885:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.296894:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.296921:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083269632:0@lo:101: 00000100:00100000:1.0:1789760758.296964:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.297002:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000918770a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.297092:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269632 00000100:00100000:0.0:1789760758.297099:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269632 00000100:00100000:0.0:1789760758.297139:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789760758.297147:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069d6a355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083269632:12345-0@lo:101: 00010000:00010000:0.0:1789760758.297159:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760758.297173:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b29534c/0x838c7b3c022b73f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b73f0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.297226:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b29534c/0x838c7b3c022b73f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.297239:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b29534c/0x838c7b3c022b73f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760758.297249:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b29534c, rc 0) 00000100:00100000:0.0:1789760758.297285:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069d6a355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083269632:12345-0@lo:101: Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.297291:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789760758.297378:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083269632:0@lo:101: 00010000:00010000:1.0:1789760758.297390:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.297399:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760758.297453:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083269760:0@lo:501: 00000100:00100000:1.0:1789760758.297490:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.297510:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000918770a1 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.297523:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269760 00000100:00100000:1.0:1789760758.297527:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269760 00000100:00100000:1.0:1789760758.297548:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760758.297553:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c562f878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083269760:12345-0@lo:501: 00000100:00100000:1.0:1789760758.297780:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c562f878 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083269760:12345-0@lo:501: Request processed in 227us (291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760758.297788:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789760758.297822:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a019a62d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083269760:0@lo:501: 10000000:01000000:1.0:1789760758.297855:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789760758.297860:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760758.297867:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: 000000000bd0484a/0x838c7b3c022b73f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789760758.323263:0:6434:0:(import.c:65:import_set_state_nolock()) 00000000a62bfe9e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760758.323381:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a81c9a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3427:x1876700083268864:12345-0@lo:38: Request processed in 31285us (31428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.323392:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760758.324575:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760758.324589:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789760758.324599:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789760758.324604:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789760758.324608:0:3427:0:(import.c:65:import_set_state_nolock()) 00000000dcacff52 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789760758.324626:0:3427:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e823d782): req@00000000478383d1 x1876700083269376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760758.324647:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e9fb6bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083268864:0@lo:38: 00000100:00100000:1.0:1789760758.324760:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.325518:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269376 00000100:00100000:1.0:1789760758.325526:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269376 00000100:00100000:1.0:1789760758.325628:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760758.325637:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a019a62d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083269376:12345-0@lo:1000: 00000100:00100000:1.0:1789760758.325720:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a019a62d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083269376:12345-0@lo:1000: Request processed in 85us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.325727:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760758.325770:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000478383d1 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083269376:0@lo:1000: 00000040:01000000:1.0:1789760758.325802:0:7340:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789760758.326615:0:7340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083269888:0@lo:1000: 00000100:00100000:1.0:1789760758.326655:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.326682:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083269888 00000100:00100000:1.0:1789760758.326686:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083269888 00000100:00100000:1.0:1789760758.326712:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760758.326718:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001032719f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083269888:12345-0@lo:1000: 00000100:00100000:1.0:1789760758.326895:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001032719f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083269888:12345-0@lo:1000: Request processed in 177us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.326901:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789760758.326920:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d743777 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.326935:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083269888:0@lo:1000: 00000100:00100000:1.0:1789760758.326979:0:7340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270016:0@lo:700: 00000100:00100000:1.0:1789760758.327000:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.327019:0:6438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270016 00000100:00100000:1.0:1789760758.327022:0:6438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270016 00000100:00100000:1.0:1789760758.327044:0:6438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760758.327049:0:6438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b88bfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083270016:12345-0@lo:700: 00000100:00100000:1.0:1789760758.327077:0:6438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b88bfe pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083270016:12345-0@lo:700: Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.327083:0:6438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760758.327096:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 00000000938a9c95 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.327106:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270016:0@lo:700: 00000100:00100000:1.0:1789760758.327249:0:7340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270144:0@lo:1000: 00000100:00100000:1.0:1789760758.327270:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.327284:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270144 00000100:00100000:1.0:1789760758.327287:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270144 00000100:00100000:1.0:1789760758.327303:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760758.327307:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d46f859 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083270144:12345-0@lo:1000: 00000100:00100000:1.0:1789760758.327343:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d46f859 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083270144:12345-0@lo:1000: Request processed in 36us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.327348:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789760758.327361:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031fc6ae1 going to sleep for 11 seconds 00000100:00100000:1.0:1789760758.327370:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270144:0@lo:1000: 00000004:00080000:1.0:1789760758.327401:0:7340:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000938a9c95 with version 0 00000020:00100000:1.0:1789760758.327412:0:7340:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789760758.327418:0:7340:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005421872f x1876700083270400/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789760758.327439:0:7340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270400:0@lo:1000: 00000100:00100000:1.0:1789760758.327459:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.327474:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270400 00000100:00100000:1.0:1789760758.327476:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270400 00000100:00100000:1.0:1789760758.327492:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789760758.327496:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0706fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7340:x1876700083270400:12345-0@lo:1000: 00000100:00100000:1.0:1789760758.329120:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b801292 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.329148:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083270528:0@lo:41: 00000100:00100000:0.0:1789760758.329234:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760758.330196:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270528 00000100:00100000:1.0:1789760758.330206:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270528 00000100:00100000:1.0:1789760758.330245:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760758.330254:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db5da0de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3428:x1876700083270528:12345-0@lo:41: 00000004:00000024:1.0:1789760758.330293:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760758.330478:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db5da0de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3428:x1876700083270528:12345-0@lo:41: Request processed in 169us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760758.330486:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760758.330800:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000718f2495 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083270528:0@lo:41: 00000001:00080000:3.0:1789760758.376119:0:7235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789760758.376135:0:7235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789760758.376362:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0706fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7340:x1876700083270400:12345-0@lo:1000: Request processed in 48860us (48897us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789760758.376377:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1789760758.376480:0:7340:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789760758.376485:0:7340:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789760758.376502:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005421872f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270400:0@lo:1000: 00000100:00100000:3.0:1789760758.376594:0:7340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005cde6868 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270656:0@lo:1000: 00000100:00100000:3.0:1789760758.376639:0:7340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760758.376692:0:7340:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f89d2620 going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.376736:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270656 00000100:00100000:0.0:1789760758.376744:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270656 00000100:00100000:0.0:1789760758.376798:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760758.376807:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6c2029d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7340:x1876700083270656:12345-0@lo:1000: 00000100:00100000:0.0:1789760758.376895:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6c2029d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7340:x1876700083270656:12345-0@lo:1000: Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760758.376902:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789760758.376930:0:7340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005cde6868 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7340:1876700083270656:0@lo:1000: 00000040:00080000:0.0:1789760758.376947:0:7340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789760758.376982:0:7340:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000000cbf600b with version 1 00000040:00080000:0.0:1789760758.378979:0:7340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789760758.379052:0:7340:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789760758.379057:0:7340:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1789760758.379149:0:7337:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000418291ae version 1 rpc_version 1 00000020:00100000:0.0:1789760758.379209:0:7337:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789760758.379221:0:7337:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000070037922 x1876700083270912/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789760758.379243:0:7337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070037922 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7337:1876700083270912:0@lo:1000: 00000100:00100000:0.0:1789760758.379314:0:7337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760758.379363:0:7337:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff3630fe going to sleep for 11 seconds 00000100:00100000:0.0:1789760758.379391:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083270912 00000100:00100000:0.0:1789760758.379399:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083270912 00000100:00100000:0.0:1789760758.379439:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760758.379446:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dc6aecc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7337:x1876700083270912:12345-0@lo:1000: 00000100:00100000:0.0:1789760758.407793:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dc6aecc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7337:x1876700083270912:12345-0@lo:1000: Request processed in 28337us (28470us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789760758.407810:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760758.407902:0:7337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070037922 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7337:1876700083270912:0@lo:1000: 00000001:00080000:3.0:1789760758.407988:0:7235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00010000:00010000:2.0:1789760759.110379:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760760.139363:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789760760.262139:0:7498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789760761.159887:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760761.735026:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ec98f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083271040:0@lo:41: 00000100:00100000:1.0:1789760761.735114:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760761.735629:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271040 00000100:00100000:3.0:1789760761.735641:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271040 00000100:00100000:3.0:1789760761.735702:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789760761.735712:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058bf1e2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083271040:12345-0@lo:41: 00000004:00000024:3.0:1789760761.735776:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760761.740709:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058bf1e2b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083271040:12345-0@lo:41: Request processed in 4985us (5582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760761.740728:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760761.742087:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ec98f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083271040:0@lo:41: 00010000:00010000:2.0:1789760762.183395:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760763.206443:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760763.785114:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c05b3e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083271168:0@lo:400: 00000100:00100000:2.0:1789760763.785215:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760763.785272:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083271680:0@lo:400: 00000100:00100000:2.0:1789760763.785298:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760763.785325:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789760763.785331:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a080010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3430:1876700083271296:0@lo:400: 00000100:00100000:2.0:1789760763.785354:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760763.785382:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083271424:0@lo:400: 00000100:00100000:2.0:1789760763.785405:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760763.785422:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760763.785427:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e06183a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083271552:0@lo:400: 00000100:00100000:2.0:1789760763.785447:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760763.785480:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271296 00000100:00100000:2.0:1789760763.785489:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271296 00000100:00100000:2.0:1789760763.785535:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271552 00000100:00100000:2.0:1789760763.785538:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271552 00000100:00100000:2.0:1789760763.785556:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789760763.785565:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3a0bc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3430:x1876700083271296:12345-0@lo:400: 00000100:00100000:2.0:1789760763.785628:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3a0bc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3430:x1876700083271296:12345-0@lo:400: Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.785637:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760763.785641:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271168 00000100:00100000:1.0:1789760763.785647:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271168 00000100:00100000:2.0:1789760763.785658:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789760763.785667:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf99272f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083271552:12345-0@lo:400: 00000100:00100000:1.0:1789760763.785679:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789760763.785689:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000983cb14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:3430:x1876700083271168:12345-0@lo:400: 00000100:00100000:2.0:1789760763.785720:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf99272f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083271552:12345-0@lo:400: Request processed in 55us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.785728:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760763.785746:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000983cb14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:3430:x1876700083271168:12345-0@lo:400: Request processed in 59us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.785753:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271680 00000100:00100000:1.0:1789760763.785756:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789760763.785759:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271680 00000100:00100000:2.0:1789760763.785787:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271424 00000100:00100000:2.0:1789760763.785791:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271424 00000100:00100000:2.0:1789760763.785822:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760763.785828:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001334896c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083271680:12345-0@lo:400: 00000100:00100000:2.0:1789760763.785865:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001334896c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083271680:12345-0@lo:400: Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.785871:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760763.785882:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760763.785887:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000792b408a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083271424:12345-0@lo:400: 00000100:00100000:2.0:1789760763.785912:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000792b408a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083271424:12345-0@lo:400: Request processed in 25us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760763.785917:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789760763.785960:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000e06183a x1876700083271552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760763.785975:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e06183a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083271552:0@lo:400: 00000100:00100000:2.0:1789760763.785987:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083271424:0@lo:400: 00010000:00080000:2.0:1789760763.786016:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003a080010 x1876700083271296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760763.786025:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a080010 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3430:1876700083271296:0@lo:400: 00000100:00100000:2.0:1789760763.786032:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c05b3e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083271168:0@lo:400: 00000100:00100000:2.0:1789760763.786047:0:3430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000004:00080000:2.0:1789760763.786052:0:3430:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789760763.786065:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083271680:0@lo:400: 00000100:00100000:0.0:1789760763.786438:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083271808:0@lo:41: 00000100:00100000:0.0:1789760763.786470:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760763.786747:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271808 00000100:00100000:1.0:1789760763.786753:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271808 00000100:00100000:1.0:1789760763.786786:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760763.786802:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c569d9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083271808:12345-0@lo:41: 00000004:00000024:1.0:1789760763.786842:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760763.786898:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c569d9ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083271808:12345-0@lo:41: Request processed in 105us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760763.786904:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789760763.789268:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083271808:0@lo:41: 00010000:00010000:0.0:1789760764.233872:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789760764.326171:0:7699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdf365120 20000000:00000080:1.0:1789760764.326505:0:7699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9330b5e35000 uarg=0000000000000000 20000000:01000000:1.0:1789760764.326537:0:7699:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789760764.326543:0:7699:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789760764.326548:0:7699:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789760764.326733:0:7699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789760764.326747:0:7699:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789760764.333151:0:7699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760764.333517:0:7699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789760764.333576:0:7699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789760764.333631:0:7699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789760764.333650:0:7699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789760764.333670:0:7699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.333958:0:7699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.333966:0:7699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.333973:0:7699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.334037:0:7699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.334053:0:7699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 17 pid: 6422 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.334068:0:7699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7699:1876700083271936:0@lo:104: 00000100:00100000:0.0:1789760764.334143:0:7699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760764.334226:0:7699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.334233:0:7699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.334241:0:7699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098a55882 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7699:1876700083272064:0@lo:104: 00000100:00100000:0.0:1789760764.334267:0:7699:0:(client.c:2715:ptlrpc_set_wait()) set 00000000064b937e going to sleep for 11 seconds 00000100:00100000:3.0:1789760764.334801:0:6414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789760764.334823:0:6414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760764.334848:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083271936 00000100:00100000:3.0:1789760764.334856:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083271936 00000100:00100000:3.0:1789760764.334895:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272064 00000100:00100000:3.0:1789760764.334899:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272064 00000100:00100000:3.0:1789760764.334914:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760764.334922:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035125977 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:7699:x1876700083271936:12345-0@lo:104: 00010000:00010000:3.0:1789760764.334935:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.335005:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760764.335011:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035125977 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:7699:x1876700083271936:12345-0@lo:104: Request processed in 89us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760764.335019:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760764.335040:0:7699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000589a8262 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7699:1876700083271936:0@lo:104: 00000100:00100000:3.0:1789760764.335067:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760764.335075:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079f15220 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:7699:x1876700083272064:12345-0@lo:104: 00010000:00010000:2.0:1789760764.335081:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760764.335082:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335090:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335100:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a2ba047 already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760764.335104:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335118:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.335126:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1789760764.335127:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760764.335136:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079f15220 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:7699:x1876700083272064:12345-0@lo:104: Request processed in 62us (312us total) trans 0 rc 0/0 10000000:01000000:2.0:1789760764.335138:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789760764.335148:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789760764.335176:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760764.335177:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335206:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760764.335225:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335231:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 000000000a2ba047/0x838c7b3c022b7364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b736b expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335257:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760764.335259:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760764.335261:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760764.335275:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083272192:0@lo:103: 00000100:00100000:2.0:1789760764.335323:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760764.335369:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272192 00000100:00100000:2.0:1789760764.335373:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272192 00010000:00010000:2.0:1789760764.335391:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 18 pid: 6422 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760764.335414:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760764.335419:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c05b3e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+18:3428:x1876700083272192:12345-0@lo:103: 00010000:00010000:2.0:1789760764.335431:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760764.335435:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 18 pid: 6422 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335445:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 18 pid: 6422 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335463:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a21f445a/0x838c7b3c022b736b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7364 expref: 18 pid: 6422 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.335478:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760764.335505:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c05b3e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+17:3428:x1876700083272192:12345-0@lo:103: Request processed in 87us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760764.335511:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789760764.335537:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083272192:0@lo:103: 00000100:00100000:2.0:1789760764.335576:0:7699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098a55882 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7699:1876700083272064:0@lo:104: 00010000:00010000:2.0:1789760764.335595:0:7699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760764.336112:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760764.336116:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760764.336118:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760764.337680:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.337697:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eec302af already unused, calling callback (0000000059ad114f) 10000000:00010000:2.0:1789760764.337700:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.337710:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760764.337716:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760764.337732:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789760764.337781:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.337788:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760764.337826:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.337833:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: 00000000eec302af/0x838c7b3c022b7276 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b727d expref: -99 pid: 6411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.337850:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760764.337852:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760764.337865:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760764.337873:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760764.337894:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083272320:0@lo:103: 00000100:00100000:2.0:1789760764.337957:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760764.338005:0:7244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272320 00000100:00100000:0.0:1789760764.338016:0:7244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272320 00010000:00010000:0.0:1789760764.338048:0:7244:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.338098:0:7244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789760764.338107:0:7244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a080010 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+17:3428:x1876700083272320:12345-0@lo:103: 00010000:00010000:0.0:1789760764.338121:0:7244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760764.338125:0:7244:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338136:0:7244:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338157:0:7244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de5d45ae/0x838c7b3c022b727d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7276 expref: 17 pid: 6425 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338173:0:7244:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338208:0:7244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338225:0:7244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338231:0:7244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338237:0:7244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338243:0:7244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338248:0:7244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fb325cc0 already unused, calling callback (00000000d208beed) 00010000:00010000:0.0:1789760764.338251:0:7244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338257:0:7244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338278:0:7244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760764.338302:0:7244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760764.338344:0:7244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a080010 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+16:3428:x1876700083272320:12345-0@lo:103: Request processed in 238us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760764.338352:0:7244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789760764.338431:0:7699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.338442:0:7699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760764.338448:0:7699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fb325cc0/0x838c7b3c022b73fe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760764.338636:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000065a0dda3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083272320:0@lo:103: 00010000:00010000:2.0:1789760765.255586:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760766.022268:0:6427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760766.022276:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933099616800 from 1 10000000:01000000:1.0:1789760766.022281:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760766.022331:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: 00000000d9c3b295/0x838c7b3c022b7405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.022343:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: 00000000d9c3b295/0x838c7b3c022b7405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.022356:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: 00000000d9c3b295/0x838c7b3c022b7405 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760766.022380:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052715096 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272448:0@lo:101: 00000100:00100000:1.0:1789760766.022453:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760766.022507:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 000000003faeb05e going to sleep for 11 seconds 00000100:00100000:3.0:1789760766.022578:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272448 00000100:00100000:3.0:1789760766.022590:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272448 00000100:00100000:3.0:1789760766.022651:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789760766.022660:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ed91ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083272448:12345-0@lo:101: 00010000:00010000:3.0:1789760766.022676:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760766.022690:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d569465b/0x838c7b3c022b740c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7405 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.022716:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d569465b/0x838c7b3c022b740c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7405 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.022727:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d569465b/0x838c7b3c022b740c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7405 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.022737:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d569465b, rc 0) 00000100:00100000:3.0:1789760766.022808:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ed91ea1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083272448:12345-0@lo:101: Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760766.022816:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789760766.022971:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052715096 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272448:0@lo:101: 00010000:00010000:2.0:1789760766.022985:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: 00000000d9c3b295/0x838c7b3c022b7405 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b740c expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.022995:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: 00000000d9c3b295/0x838c7b3c022b7405 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b740c expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760766.023054:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272576:0@lo:501: 00000100:00100000:2.0:1789760766.023082:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.023110:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da8ccd1a going to sleep for 11 seconds 00000100:00100000:3.0:1789760766.023269:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272576 00000100:00100000:3.0:1789760766.023274:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272576 00000100:00100000:3.0:1789760766.023299:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789760766.023305:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdaffb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083272576:12345-0@lo:501: 00000100:00100000:3.0:1789760766.023547:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdaffb64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083272576:12345-0@lo:501: Request processed in 242us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760766.023554:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789760766.023641:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272576:0@lo:501: 00000100:00100000:2.0:1789760766.023674:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272704:0@lo:503: 00000100:00100000:2.0:1789760766.023712:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.023749:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da8ccd1a going to sleep for 11 seconds 00000100:00100000:1.0:1789760766.023924:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272704 00000100:00100000:1.0:1789760766.023929:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272704 00000100:00100000:1.0:1789760766.023964:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789760766.023971:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000523bec0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083272704:12345-0@lo:503: 00000100:00100000:1.0:1789760766.024096:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000523bec0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083272704:12345-0@lo:503: Request processed in 126us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760766.024104:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789760766.024214:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083272704:0@lo:503: 00000100:00100000:2.0:1789760766.028003:0:7768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7768:1876700083272832:0@lo:502: 00000100:00100000:2.0:1789760766.028254:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.028394:0:7768:0:(client.c:2715:ptlrpc_set_wait()) set 00000000722c2c95 going to sleep for 11 seconds 00000100:00100000:1.0:1789760766.031270:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272832 00000100:00100000:1.0:1789760766.031283:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272832 00000100:00100000:1.0:1789760766.031333:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789760766.031342:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cb571d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:7768:x1876700083272832:12345-0@lo:502: 00000100:00100000:1.0:1789760766.031586:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cb571d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:7768:x1876700083272832:12345-0@lo:502: Request processed in 244us (3334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760766.031596:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789760766.031964:0:7768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0fe2e0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7768:1876700083272832:0@lo:502: 00000020:01000000:2.0:1789760766.032002:0:7768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760766.032012:0:7768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760766.032015:0:7768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789760766.032022:0:7768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933099616800 00000020:00000080:2.0:1789760766.032024:0:7768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789760766.032086:0:7768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7768:1876700083272960:0@lo:502: 00000100:00100000:2.0:1789760766.032138:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.032205:0:7768:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760766.032282:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083272960 00000100:00100000:1.0:1789760766.032288:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083272960 00000100:00100000:1.0:1789760766.032333:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789760766.032342:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:7768:x1876700083272960:12345-0@lo:502: 00000100:00100000:1.0:1789760766.032478:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:7768:x1876700083272960:12345-0@lo:502: Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760766.032486:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789760766.032570:0:7768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7768:1876700083272960:0@lo:502: 00000020:01000000:2.0:1789760766.032590:0:7768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760766.032595:0:7768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760766.032596:0:7768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789760766.032600:0:7768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789760766.032750:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789760766.032770:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760766.032791:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650a00/0x838c7b3c022b7405 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b740c expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.032803:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081650a00/0x838c7b3c022b7405 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b740c expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760766.032826:0:6427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789760766.032829:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933087a7b000 from 1 10000000:01000000:1.0:1789760766.032831:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760766.032860:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.032868:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760766.032878:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760766.032893:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273088:0@lo:101: 00000100:00100000:1.0:1789760766.032923:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760766.032953:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760766.033096:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273088 00000100:00100000:2.0:1789760766.033102:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273088 00000100:00100000:2.0:1789760766.033136:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789760766.033144:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083273088:12345-0@lo:101: 00010000:00010000:2.0:1789760766.033155:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760766.033170:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f8000/0x838c7b3c022b741a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7413 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.033223:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f8000/0x838c7b3c022b741a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7413 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.033248:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f8000/0x838c7b3c022b741a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7413 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.033258:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f8000, rc 0) 00000100:00100000:2.0:1789760766.033296:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083273088:12345-0@lo:101: Request processed in 152us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.033303:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789760766.033336:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273088:0@lo:101: 00010000:00010000:2.0:1789760766.033349:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b741a expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.033359:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b741a expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760766.033407:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273216:0@lo:501: 00000100:00100000:2.0:1789760766.033432:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.033445:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760766.033457:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273216 00000100:00100000:2.0:1789760766.033460:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273216 00000100:00100000:2.0:1789760766.033481:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789760766.033487:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083273216:12345-0@lo:501: 00000100:00100000:2.0:1789760766.033715:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083273216:12345-0@lo:501: Request processed in 227us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.033722:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789760766.033751:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273216:0@lo:501: 00000100:00100000:2.0:1789760766.033775:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273344:0@lo:503: 00000100:00100000:2.0:1789760766.033829:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.033844:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789760766.033856:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273344 00000100:00100000:2.0:1789760766.033860:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273344 00000100:00100000:2.0:1789760766.033881:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760766.033887:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083273344:12345-0@lo:503: 00000100:00100000:2.0:1789760766.034001:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083273344:12345-0@lo:503: Request processed in 113us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.034008:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789760766.034045:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083273344:0@lo:503: 00000100:00100000:2.0:1789760766.034221:0:7770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7770:1876700083273472:0@lo:502: 00000100:00100000:2.0:1789760766.034255:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.034274:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273472 00000100:00100000:2.0:1789760766.034278:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273472 00000100:00100000:2.0:1789760766.034299:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789760766.034305:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:7770:x1876700083273472:12345-0@lo:502: 00000100:00100000:2.0:1789760766.034402:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:7770:x1876700083273472:12345-0@lo:502: Request processed in 97us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.034409:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789760766.034440:0:7770:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760766.034453:0:7770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7770:1876700083273472:0@lo:502: 00000020:01000000:2.0:1789760766.034473:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760766.034482:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760766.034484:0:7770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789760766.034491:0:7770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933087a7b000 00000020:00000080:2.0:1789760766.034493:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789760766.034512:0:7770:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7770:1876700083273600:0@lo:502: 00000100:00100000:2.0:1789760766.034549:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760766.034567:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273600 00000100:00100000:2.0:1789760766.034570:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273600 00000100:00100000:2.0:1789760766.034592:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789760766.034598:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:7770:x1876700083273600:12345-0@lo:502: 00000100:00100000:2.0:1789760766.034683:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:7770:x1876700083273600:12345-0@lo:502: Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760766.034690:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789760766.034720:0:7770:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760766.034731:0:7770:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:7770:1876700083273600:0@lo:502: 00000020:01000000:2.0:1789760766.034747:0:7770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760766.034751:0:7770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760766.034752:0:7770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789760766.034755:0:7770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789760766.034807:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789760766.034825:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789760766.034834:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b741a expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760766.034844:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081651c00/0x838c7b3c022b7413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b741a expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760766.278305:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760766.857647:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760766.857671:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083273728:0@lo:41: 00000100:00100000:3.0:1789760766.857824:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760766.857883:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273728 00000100:00100000:3.0:1789760766.857892:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273728 00000100:00100000:3.0:1789760766.857938:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760766.857947:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083273728:12345-0@lo:41: 00000004:00000024:3.0:1789760766.857987:0:6434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789760766.858030:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083273728:12345-0@lo:41: Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760766.858037:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760766.858084:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083273728:0@lo:41: 00010000:00010000:2.0:1789760767.302599:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760768.327290:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760768.905486:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083273856:0@lo:400: 00000100:00100000:3.0:1789760768.905569:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.905617:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083274368:0@lo:400: 00000100:00100000:3.0:1789760768.905643:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.905672:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760768.905678:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083274240:0@lo:400: 00000100:00100000:3.0:1789760768.905708:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.905738:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083273984:0@lo:400: 00000100:00100000:3.0:1789760768.905778:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.905798:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760768.905803:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083274112:0@lo:400: 00000100:00100000:3.0:1789760768.905825:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760768.905858:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273856 00000100:00100000:3.0:1789760768.905866:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273856 00000100:00100000:3.0:1789760768.905926:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760768.905935:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:3431:x1876700083273856:12345-0@lo:400: 00000100:00100000:3.0:1789760768.905993:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:3431:x1876700083273856:12345-0@lo:400: Request processed in 59us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.906001:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789760768.906039:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274368 00000100:00100000:3.0:1789760768.906043:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274368 00000100:00100000:3.0:1789760768.906065:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274112 00000100:00100000:3.0:1789760768.906067:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274112 00000100:00100000:3.0:1789760768.906080:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760768.906086:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083274368:12345-0@lo:400: 00000100:00100000:3.0:1789760768.906121:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083274368:12345-0@lo:400: Request processed in 35us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.906127:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789760768.906138:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760768.906144:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083274112:12345-0@lo:400: 00000100:00100000:3.0:1789760768.906175:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083274112:12345-0@lo:400: Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.906202:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760768.906223:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274240 00000100:00100000:3.0:1789760768.906227:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274240 00000100:00100000:3.0:1789760768.906249:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083273984 00000100:00100000:3.0:1789760768.906252:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083273984 00000100:00100000:3.0:1789760768.906264:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760768.906270:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083274240:12345-0@lo:400: 00000100:00100000:3.0:1789760768.906300:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083274240:12345-0@lo:400: Request processed in 30us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.906307:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760768.906325:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760768.906331:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083273984:12345-0@lo:400: 00000100:00100000:3.0:1789760768.906356:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083273984:12345-0@lo:400: Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760768.906362:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760768.906413:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083274112:0@lo:400: 00010000:00080000:3.0:1789760768.906427:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9330bd505f80 x1876700083273984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760768.906437:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083273984:0@lo:400: 00010000:00080000:3.0:1789760768.906463:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9330bd507800 x1876700083274240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760768.906471:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083274240:0@lo:400: 00000100:00100000:3.0:1789760768.906479:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083273856:0@lo:400: 00000100:00100000:3.0:1789760768.906487:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083274368:0@lo:400: 00000100:00100000:0.0:1789760768.912061:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083274496:0@lo:41: 00000100:00100000:0.0:1789760768.912145:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760768.912539:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274496 00000100:00100000:2.0:1789760768.912548:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274496 00000100:00100000:2.0:1789760768.912600:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789760768.912611:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083274496:12345-0@lo:41: 00000004:00000024:2.0:1789760768.912653:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760768.912751:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083274496:12345-0@lo:41: Request processed in 141us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760768.912767:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760768.913993:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083274496:0@lo:41: 00010000:00010000:3.0:1789760769.350440:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789760769.395367:0:8072:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789760769.395370:0:8072:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789760769.395503:0:8072:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9330b4757000 00000020:01000004:3.0:1789760769.395521:0:8072:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789760769.395534:0:8072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789760769.395548:0:8072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9330ad673370) 00000020:00000080:3.0:1789760769.395565:0:8072:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789760769.412015:0:8072:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789760769.412557:0:8072:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789760769.432435:0:8072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789760769.436647:0:8072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789760769.436681:0:8072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789760769.436748:0:8072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789760769.436789:0:8072:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789760769.437129:0:8072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789760769.437142:0:8072:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789760769.437152:0:8072:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x838c7b3c022b7428 00000020:01000004:3.0:1789760769.437160:0:8072:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789760769.437288:0:8072:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789760769.437293:0:8072:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789760769.437299:0:8072:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789760769.437483:0:8072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789760769.437497:0:8072:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9330888099b8) 00000020:00000080:2.0:1789760769.437509:0:8072:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789760769.438679:0:8072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760769.438863:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789760769.438870:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789760769.445522:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789760769.445543:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789760769.447387:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789760769.447408:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789760769.448923:0:8072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760769.449161:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789760769.449176:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789760769.449934:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789760769.449942:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789760769.471118:0:8072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789760769.471619:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789760769.471627:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789760769.473130:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789760769.473142:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789760769.476677:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789760769.476767:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789760769.485433:0:8072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760769.485647:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789760769.485654:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789760769.488903:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789760769.488925:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789760769.546482:0:8072:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789760769.546844:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789760769.546867:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789760769.548465:0:8072:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789760769.548478:0:8072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789760769.549089:0:8072:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789760769.549114:0:8072:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789760769.549121:0:8072:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789760769.572950:0:8072:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789760769.572989:0:8072:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.153@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789760769.572994:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789760769.572996:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760769.572997:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760769.572998:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760769.573000:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760769.573001:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760769.573003:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760769.573005:0:8072:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760769.573006:0:8072:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760769.573008:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760769.573010:0:8072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760769.573013:0:8072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789760769.573015:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760769.573017:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760769.573018:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760769.573024:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760769.573025:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760769.573026:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760769.573027:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760769.573028:0:8072:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760769.573029:0:8072:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760769.573030:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760769.573030:0:8072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760769.573069:0:8072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789760769.573090:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083274624:0@lo:253: 00000100:00100000:2.0:1789760769.573164:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.573352:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b58803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760769.573506:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274624 00000100:00100000:1.0:1789760769.573516:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274624 00000100:00100000:1.0:1789760769.573748:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789760769.573770:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:8072:x1876700083274624:12345-0@lo:253: 20000000:01000000:1.0:1789760769.573806:0:6422:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789760769.573811:0:6422:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789760769.573816:0:6422:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789760769.573820:0:6422:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789760769.574910:0:6422:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789760769.575138:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789760769.575153:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789760769.575240:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789760769.575250:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789760769.575284:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789760769.575501:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789760769.575804:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789760769.575823:0:6422:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:1.0:1789760769.575825:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789760769.575858:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789760769.575866:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760769.575911:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789760769.575919:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1789760769.575950:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789760769.575959:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760769.575989:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789760769.576040:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789760769.576898:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789760769.576920:0:6422:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:1.0:1789760769.576923:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789760769.576960:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789760769.576969:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789760769.577037:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789760769.577047:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1789760769.577084:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789760769.577094:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760769.577123:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789760769.577406:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789760769.578393:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789760769.578416:0:6422:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:1.0:1789760769.578419:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:1.0:1789760769.578469:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789760769.578478:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789760769.578509:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789760769.578519:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:1.0:1789760769.578662:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789760769.578674:0:6422:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789760769.578725:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789760769.578778:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789760769.578795:0:6422:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789760769.578798:0:6422:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789760769.578801:0:6422:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789760769.578813:0:6422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789760769.578816:0:6422:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789760769.578847:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789760769.578849:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760769.579865:0:8087:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760769.579931:0:8087:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760769.580004:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789760769.580590:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789760769.580639:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789760769.580676:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789760769.580689:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789760769.580691:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760769.581406:0:8088:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760769.581464:0:8088:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760769.581517:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789760769.581873:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789760769.581913:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789760769.581966:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789760769.581978:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789760769.581980:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760769.582746:0:8089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789760769.583021:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789760769.583066:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789760769.583130:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789760769.583144:0:6422:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789760769.583146:0:6422:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760769.584087:0:8090:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760769.584149:0:8090:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760769.584398:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789760769.584855:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789760769.584896:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789760769.584966:0:6422:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789760769.584987:0:6422:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789760769.584990:0:6422:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789760769.584998:0:6422:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789760769.585021:0:6422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585041:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585049:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585056:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585062:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585070:0:6422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585078:0:6422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585124:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585140:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.585156:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083274752:0@lo:104: 00000100:00100000:1.0:1789760769.585458:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760769.585571:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585590:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 18 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.585598:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083274880:0@lo:104: 00000100:00100000:1.0:1789760769.585622:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760769.585827:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.585836:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 18 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.585844:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275008:0@lo:104: 00000100:00100000:1.0:1789760769.585869:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.585932:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274752 00000100:00100000:3.0:1789760769.585941:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274752 00000100:00100000:3.0:1789760769.585981:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083274880 00000100:00100000:3.0:1789760769.585984:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083274880 00000100:00100000:3.0:1789760769.585999:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760769.586009:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309ea4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083274752:12345-0@lo:104: 00010000:00010000:3.0:1789760769.586024:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.586085:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760769.586092:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309ea4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083274752:12345-0@lo:104: Request processed in 84us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.586099:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760769.586116:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760769.586123:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309ea4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083274880:12345-0@lo:104: 00010000:00010000:3.0:1789760769.586129:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.586164:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789760769.586169:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309ea4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083274880:12345-0@lo:104: Request processed in 48us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.586175:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789760769.586214:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760769.586227:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.586234:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933081651400 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760769.586237:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.586245:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760769.586253:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760769.586257:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760769.586287:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.586293:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760769.586410:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760769.586416:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586423:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330814f8a00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760769.586425:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586431:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760769.586437:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760769.586441:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760769.586457:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586461:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760769.586476:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586493:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b73c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73cd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586508:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.586511:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.586512:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760769.586535:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760769.586560:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083275136:0@lo:103: 00000100:00100000:2.0:1789760769.586603:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.586649:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275136 00000100:00100000:2.0:1789760769.586653:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275136 00010000:00010000:2.0:1789760769.586672:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 19 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.586693:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760769.586700:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bcab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+19:3428:x1876700083275136:12345-0@lo:103: 00010000:00010000:2.0:1789760769.586710:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760769.586715:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 19 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586726:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 19 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586743:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760769.586781:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bcab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+19:3428:x1876700083275136:12345-0@lo:103: Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.586787:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760769.586823:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083275136:0@lo:103: 00000100:00100000:2.0:1789760769.586861:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083275264:0@lo:103: 00000100:00100000:2.0:1789760769.586887:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.586912:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275264 00000100:00100000:2.0:1789760769.586916:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275264 00010000:00010000:2.0:1789760769.586929:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.586952:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760769.586958:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bcab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+19:3430:x1876700083275264:12345-0@lo:103: 00010000:00010000:2.0:1789760769.586965:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760769.586969:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586977:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.586986:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760769.587012:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bcab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+19:3430:x1876700083275264:12345-0@lo:103: Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.587017:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760769.587039:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083275264:0@lo:103: 00010000:00010000:3.0:1789760769.587255:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.587264:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b73f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73f7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587404:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.587407:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.587409:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760769.587503:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 18 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.587515:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 18 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.587525:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275392:0@lo:104: 00000100:00100000:3.0:1789760769.587667:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275008 00000100:00100000:3.0:1789760769.587672:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275008 00000100:00100000:3.0:1789760769.587696:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789760769.587704:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083275008:12345-0@lo:104: 00010000:00010000:3.0:1789760769.587715:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.587790:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760769.587796:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083275008:12345-0@lo:104: Request processed in 93us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.587802:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789760769.587849:0:7700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760769.587855:0:7700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587862:0:7700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933080031200 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760769.587872:0:7700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587881:0:7700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760769.587888:0:7700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760769.587894:0:7700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760769.587926:0:7700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587933:0:7700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760769.587948:0:7700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587954:0:7700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933080031200/0x838c7b3c022b73aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73b1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.587968:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.587970:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.587971:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760769.587982:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083275520:0@lo:103: 00000100:00100000:2.0:1789760769.588010:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.588041:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275520 00000100:00100000:2.0:1789760769.588045:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275520 00010000:00010000:2.0:1789760769.588060:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.588080:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760769.588095:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bcab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+19:3431:x1876700083275520:12345-0@lo:103: 00010000:00010000:2.0:1789760769.588104:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760769.588109:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.588120:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.588132:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760769.588160:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bcab6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+19:3431:x1876700083275520:12345-0@lo:103: Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.588166:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760769.588225:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083275520:0@lo:103: 00000100:00100000:1.0:1789760769.588406:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760769.588444:0:6422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.588453:0:6422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.588463:0:6422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275648:0@lo:104: 00000100:00100000:1.0:1789760769.588492:0:6422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.588503:0:6422:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00010000:00010000:1.0:1789760769.588517:0:6422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459800/0x838c7b3c022b73f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b73f0 expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.588526:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083274752:0@lo:104: 00010000:00010000:1.0:1789760769.588535:0:6422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b73cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b73c6 expref: 17 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.588686:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275392 00000100:00100000:3.0:1789760769.588691:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275392 00000100:00100000:3.0:1789760769.588709:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275648 00000100:00100000:3.0:1789760769.588711:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275648 00000100:00100000:3.0:1789760769.588722:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760769.588727:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083275392:12345-0@lo:104: 00010000:00010000:3.0:1789760769.588736:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588788:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760769.588793:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6422:x1876700083275392:12345-0@lo:104: Request processed in 66us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.588799:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760769.588812:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760769.588818:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083275648:12345-0@lo:104: 00010000:00010000:3.0:1789760769.588826:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588859:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789760769.588864:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6422:x1876700083275648:12345-0@lo:104: Request processed in 47us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.588870:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789760769.588884:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760769.588895:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588904:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330814f9200 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760769.588907:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588914:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760769.588920:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760769.588925:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760769.588949:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588955:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760769.588970:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588977:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330814f9200/0x838c7b3c022b7372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7379 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588988:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760769.588991:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.588997:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93308167fa00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760769.589000:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589019:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760769.589024:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760769.589029:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760769.589043:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589049:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760769.589055:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589061:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff93308167fa00/0x838c7b3c022b72fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7302 expref: -99 pid: 7226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589077:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760769.589079:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760769.589081:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760769.589094:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083275904:0@lo:103: 00000100:00100000:3.0:1789760769.589121:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.589142:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760769.589148:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083275776:0@lo:103: 00000100:00100000:3.0:1789760769.589171:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.589230:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275904 00000100:00100000:3.0:1789760769.589234:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275904 00010000:00010000:3.0:1789760769.589248:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.589277:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083275776 00000100:00100000:3.0:1789760769.589281:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083275776 00010000:00010000:3.0:1789760769.589290:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 19 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.589301:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760769.589307:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+19:3429:x1876700083275904:12345-0@lo:103: 00000100:00100000:1.0:1789760769.589416:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083274880:0@lo:104: 00010000:00010000:1.0:1789760769.589433:0:6422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650200/0x838c7b3c022b73b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b73aa expref: 18 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.589442:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275008:0@lo:104: 00000100:00100000:1.0:1789760769.589450:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275392:0@lo:104: 00000100:00100000:1.0:1789760769.589456:0:6422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6422:1876700083275648:0@lo:104: 00010000:00010000:1.0:1789760769.589483:0:6422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.589567:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760769.589730:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760769.589738:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+17:3429:x1876700083275776:12345-0@lo:103: 00010000:00010000:2.0:1789760769.589749:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789760769.589765:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 17 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.589776:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 17 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.589789:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081651200/0x838c7b3c022b7379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7372 expref: 17 pid: 6424 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.589801:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789760769.589845:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+16:3429:x1876700083275776:12345-0@lo:103: Request processed in 108us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.589862:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789760769.589922:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789760769.589928:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 15 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589938:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 15 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589948:0:6416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93308167fe00/0x838c7b3c022b7302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b72fb expref: 15 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589963:0:6416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589972:0:6416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589987:0:6416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.589994:0:6416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.590001:0:6416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.590015:0:6416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.590021:0:6416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933081650400 already unused, calling callback (ffffffffc1470350) 00010000:00010000:3.0:1789760769.590026:0:6416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.590034:0:6416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.590113:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083275776:0@lo:103: 00010000:00010000:2.0:1789760769.590766:0:6422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.590776:0:6422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789760769.590784:0:6422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789760769.593620:0:6416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.593644:0:6416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650400/0x838c7b3c022b7436 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.593677:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789760769.593794:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+14:3429:x1876700083275904:12345-0@lo:103: Request processed in 4481us (4666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.593969:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789760769.594935:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083275904:0@lo:103: 00000100:00100000:0.0:1789760769.639626:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+13:8072:x1876700083274624:12345-0@lo:253: Request processed in 65850us (66453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.639641:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789760769.639806:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083274624:0@lo:253: 10000000:01000000:2.0:1789760769.639821:0:8072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789760769.639825:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789760769.639827:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789760769.639828:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760769.639829:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789760769.639831:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760769.639832:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760769.639834:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760769.639836:0:8072:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789760769.639837:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760769.639838:0:8072:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789760769.639860:0:8072:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9330b4757000 from lustre-OST0000 10000000:01000000:2.0:1789760769.639901:0:8072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789760769.639903:0:8072:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789760769.639911:0:8072:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93309ea30000 local copy 10000000:01000000:2.0:1789760769.639915:0:8072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760769.639955:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.639967:0:8072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.639978:0:8072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.639999:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276032:0@lo:101: 00000100:00100000:2.0:1789760769.640034:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.640090:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5880c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.640212:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276032 00000100:00100000:0.0:1789760769.640219:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276032 00000100:00100000:0.0:1789760769.640253:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789760769.640262:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+13:8072:x1876700083276032:12345-0@lo:101: 00010000:00010000:0.0:1789760769.640276:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760769.640289:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b7444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b743d expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.640325:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b7444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b743d expref: 14 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.640336:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b7444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b743d expref: 14 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.640346:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330a7459c00, rc 0) 00000100:00100000:0.0:1789760769.640373:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276032:12345-0@lo:101: Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.640394:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789760769.640530:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276032:0@lo:101: 00010000:00010000:2.0:1789760769.640542:0:8072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.640552:0:8072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.641280:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276160:0@lo:501: 00000100:00100000:2.0:1789760769.641326:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.641351:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5880c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.641604:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276160 00000100:00100000:0.0:1789760769.641612:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276160 00000100:00100000:0.0:1789760769.641653:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789760769.641661:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276160:12345-0@lo:501: 00000100:00100000:0.0:1789760769.641870:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276160:12345-0@lo:501: Request processed in 209us (543us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789760769.641878:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789760769.641918:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276160:0@lo:501: 10000000:01000000:0.0:1789760769.641934:0:8072:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789760769.641957:0:8072:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789760769.641964:0:8072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.641974:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.641981:0:8072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.641998:0:8072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789760769.642017:0:8072:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9330b4757000 00010000:00010000:0.0:1789760769.642027:0:7700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760769.642032:0:7700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642039:0:7700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330814f8a00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:0.0:1789760769.642048:0:7700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642058:0:7700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760769.642076:0:7700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760769.642082:0:7700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760769.642106:0:7700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642112:0:7700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760769.642129:0:7700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642136:0:7700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330814f8a00/0x838c7b3c022b743d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b7444 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642152:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760769.642154:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760769.642155:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760769.642165:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083276288:0@lo:103: 00000100:00100000:0.0:1789760769.642223:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.642266:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276288 00000100:00100000:0.0:1789760769.642270:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276288 00000100:00100000:0.0:1789760769.642296:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760769.642302:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+14:3430:x1876700083276288:12345-0@lo:103: 00010000:00010000:0.0:1789760769.642323:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760769.642341:0:6417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b7444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x838c7b3c022b743d expref: 14 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642354:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760769.642378:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+13:3430:x1876700083276288:12345-0@lo:103: Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.642384:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760769.642406:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083276288:0@lo:103: 10000000:01000000:0.0:1789760769.642420:0:8072:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760769.642425:0:8072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789760769.642427:0:8072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760769.642431:0:8072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789760769.642434:0:8072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760769.642452:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642460:0:8072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.642469:0:8072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.642480:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276416:0@lo:101: 00000100:00100000:0.0:1789760769.642500:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.642511:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330860f36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760769.642836:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276416 00000100:00100000:2.0:1789760769.642843:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276416 00000100:00100000:2.0:1789760769.642879:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789760769.642887:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+13:8072:x1876700083276416:12345-0@lo:101: 00010000:00010000:2.0:1789760769.642897:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760769.642909:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b744b expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.642929:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b744b expref: 14 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.642940:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b744b expref: 14 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.642958:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f9e00, rc 0) 00000100:00100000:2.0:1789760769.642991:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276416:12345-0@lo:101: Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.642997:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789760769.643430:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276416:0@lo:101: 00010000:00010000:0.0:1789760769.643443:0:8072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.643463:0:8072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.643562:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276544:0@lo:501: 00000100:00100000:0.0:1789760769.643733:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.643773:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330860f36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760769.643825:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276544 00000100:00100000:2.0:1789760769.643830:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276544 00000100:00100000:2.0:1789760769.643864:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789760769.643872:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276544:12345-0@lo:501: 00000100:00100000:2.0:1789760769.644095:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276544:12345-0@lo:501: Request processed in 222us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.644101:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789760769.644400:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276544:0@lo:501: 00000100:00100000:1.0:1789760769.644438:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276672:0@lo:503: 00000100:00100000:1.0:1789760769.644478:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.644507:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.644680:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276672 00000100:00100000:0.0:1789760769.644686:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276672 00000100:00100000:0.0:1789760769.644721:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789760769.644729:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276672:12345-0@lo:503: 00000100:00100000:0.0:1789760769.644900:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276672:12345-0@lo:503: Request processed in 171us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.644906:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789760769.645026:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276672:0@lo:503: 00000040:00080000:1.0:1789760769.645491:0:8072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760769.645832:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276800:0@lo:502: 00000100:00100000:1.0:1789760769.645880:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.645981:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.646027:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276800 00000100:00100000:0.0:1789760769.646034:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276800 00000100:00100000:0.0:1789760769.646168:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789760769.646178:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276800:12345-0@lo:502: 00000100:00100000:0.0:1789760769.647321:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276800:12345-0@lo:502: Request processed in 1141us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.647329:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789760769.647426:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276800:0@lo:502: 00000040:00080000:1.0:1789760769.647692:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789760769.647747:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789760769.647797:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789760769.647847:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789760769.647882:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789760769.647913:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789760769.647947:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276928:0@lo:502: 00000100:00100000:1.0:1789760769.647993:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.648032:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760769.648169:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083276928 00000100:00100000:2.0:1789760769.648197:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083276928 00000100:00100000:2.0:1789760769.648284:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789760769.648295:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276928:12345-0@lo:502: 00000100:00100000:2.0:1789760769.648471:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083276928:12345-0@lo:502: Request processed in 178us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.648478:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789760769.648572:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083276928:0@lo:502: 00000040:00080000:1.0:1789760769.648663:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789760769.648673:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789760769.649328:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760769.649336:0:8091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789760769.649343:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760769.649345:0:8091:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789760769.649350:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760769.649365:0:8091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9330ad670000) 00000020:00000080:3.0:1789760769.649390:0:8091:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789760769.649397:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789760769.649481:0:8091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b4757000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789760769.649488:0:8091:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789760769.649494:0:8091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x838c7b3c022b7460 00010000:00010000:2.0:1789760769.655605:0:8091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789760769.655950:0:8091:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789760769.659679:0:8091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789760769.660109:0:8091:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789760769.668985:0:8091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789760769.670551:0:8091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789760769.672730:0:8091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789760769.672743:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760769.672765:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760769.672768:0:8091:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789760769.672772:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760769.672776:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760769.672778:0:8091:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789760769.672780:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789760769.672782:0:8091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789760769.672835:0:8091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760769.672839:0:8091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760769.672840:0:8091:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789760769.672843:0:8091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789760769.673486:0:8072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789760769.673512:0:8072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789760769.673580:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.673594:0:8072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760769.673602:0:8072:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9330b4757000 from 1 10000000:01000000:1.0:1789760769.673604:0:8072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789760769.673648:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.673677:0:8072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.673699:0:8072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.673726:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277056:0@lo:101: 00000100:00100000:1.0:1789760769.673808:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.673854:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760769.673910:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277056 00000100:00100000:2.0:1789760769.673919:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277056 00000100:00100000:2.0:1789760769.673972:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789760769.673983:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083277056:12345-0@lo:101: 00010000:00010000:2.0:1789760769.673998:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760769.674012:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f9200/0x838c7b3c022b746e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7467 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.674039:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f9200/0x838c7b3c022b746e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7467 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.674051:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f9200/0x838c7b3c022b746e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7467 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.674061:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f9200, rc 0) 00000100:00100000:2.0:1789760769.674121:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277056:12345-0@lo:101: Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.674128:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789760769.674245:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277056:0@lo:101: 00010000:00010000:1.0:1789760769.674262:0:8072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b746e expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.674272:0:8072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b746e expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.674366:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277184:0@lo:501: 00000100:00100000:1.0:1789760769.674393:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.674410:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760769.676044:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277184 00000100:00100000:2.0:1789760769.676057:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277184 00000100:00100000:2.0:1789760769.676118:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789760769.676129:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277184:12345-0@lo:501: 00000100:00100000:2.0:1789760769.676457:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277184:12345-0@lo:501: Request processed in 328us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.676465:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789760769.676579:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277184:0@lo:501: 00000100:00100000:1.0:1789760769.676628:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277312:0@lo:503: 00000100:00100000:1.0:1789760769.676670:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.676707:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.677086:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277312 00000100:00100000:0.0:1789760769.677094:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277312 00000100:00100000:0.0:1789760769.677143:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789760769.677150:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277312:12345-0@lo:503: 00000100:00100000:0.0:1789760769.677406:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277312:12345-0@lo:503: Request processed in 254us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.677424:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789760769.678019:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277312:0@lo:503: 00000040:00080000:2.0:1789760769.678393:0:8072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789760769.678473:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277440:0@lo:502: 00000100:00100000:2.0:1789760769.678522:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760769.678558:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5880d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760769.678767:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277440 00000100:00100000:1.0:1789760769.678775:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277440 00000100:00100000:1.0:1789760769.678825:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760769.678844:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277440:12345-0@lo:502: 00000100:00100000:1.0:1789760769.679027:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277440:12345-0@lo:502: Request processed in 185us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.679034:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789760769.679389:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277440:0@lo:502: 00000040:00080000:1.0:1789760769.679655:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789760769.679714:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789760769.679747:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277568:0@lo:502: 00000100:00100000:1.0:1789760769.679803:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.679827:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.682226:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277568 00000100:00100000:0.0:1789760769.682240:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277568 00000100:00100000:0.0:1789760769.682300:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789760769.682310:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277568:12345-0@lo:502: 00000100:00100000:0.0:1789760769.682563:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277568:12345-0@lo:502: Request processed in 253us (2759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.682571:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789760769.683573:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277568:0@lo:502: 00000040:00080000:1.0:1789760769.683777:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789760769.683794:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789760769.684640:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760769.684651:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760769.684653:0:8095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789760769.684658:0:8095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9330b4757000 00000020:00000080:1.0:1789760769.684661:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789760769.684679:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760769.684682:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760769.684684:0:8095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789760769.684698:0:8095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789760769.684819:0:8072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789760769.684838:0:8072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789760769.684859:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b746e expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.684871:0:8072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081650200/0x838c7b3c022b7467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b746e expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760769.684913:0:8072:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789760769.684916:0:8072:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9330b4757000 10000000:01000000:0.0:1789760769.684919:0:8072:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9330b4757000 10000000:01000000:0.0:1789760769.684923:0:8072:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760769.684929:0:8072:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9330b4757000 from 1 10000000:01000000:0.0:1789760769.684931:0:8072:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760769.684971:0:8072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.684979:0:8072:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.684990:0:8072:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.685020:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277696:0@lo:101: 00000100:00100000:0.0:1789760769.685084:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.685132:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760769.685314:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277696 00000100:00100000:1.0:1789760769.685324:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277696 00000100:00100000:1.0:1789760769.685371:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760769.685382:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:8072:x1876700083277696:12345-0@lo:101: 00010000:00010000:1.0:1789760769.685398:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760769.685411:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7475 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.685445:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.685457:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.685467:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650e00, rc 0) 00000100:00100000:1.0:1789760769.685511:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083277696:12345-0@lo:101: Request processed in 130us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.685518:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789760769.685573:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277696:0@lo:101: 00010000:00010000:1.0:1789760769.685588:0:8072:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.685598:0:8072:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.685678:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277824:0@lo:501: 00000100:00100000:1.0:1789760769.687032:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.687125:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.688985:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277824 00000100:00100000:0.0:1789760769.688999:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277824 00000100:00100000:0.0:1789760769.689068:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789760769.689081:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083277824:12345-0@lo:501: 00000100:00100000:0.0:1789760769.689423:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083277824:12345-0@lo:501: Request processed in 343us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.689432:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789760769.690118:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277824:0@lo:501: 00000100:00100000:1.0:1789760769.690175:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277952:0@lo:503: 00000100:00100000:1.0:1789760769.690244:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.690274:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.690335:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083277952 00000100:00100000:0.0:1789760769.690341:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083277952 00000100:00100000:0.0:1789760769.690395:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789760769.690404:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083277952:12345-0@lo:503: 00000100:00100000:0.0:1789760769.690562:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083277952:12345-0@lo:503: Request processed in 159us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.690569:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789760769.690730:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083277952:0@lo:503: 00000040:00080000:1.0:1789760769.691041:0:8072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760769.691125:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278080:0@lo:502: 00000100:00100000:1.0:1789760769.691164:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.691217:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.691953:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278080 00000100:00100000:0.0:1789760769.691962:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278080 00000100:00100000:0.0:1789760769.692013:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789760769.692023:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083278080:12345-0@lo:502: 00000100:00100000:0.0:1789760769.692811:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083278080:12345-0@lo:502: Request processed in 788us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.692821:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789760769.693530:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278080:0@lo:502: 00000040:00080000:1.0:1789760769.694037:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789760769.694305:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789760769.694362:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789760769.694410:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789760769.694448:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789760769.694493:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789760769.694527:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789760769.694561:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789760769.694609:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789760769.694645:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789760769.694678:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789760769.694815:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789760769.694852:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789760769.694886:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789760769.694936:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789760769.694974:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789760769.695007:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789760769.695051:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789760769.695298:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789760769.695342:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789760769.695389:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789760769.695423:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789760769.695457:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789760769.695502:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789760769.695554:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789760769.695591:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789760769.695640:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789760769.695759:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789760769.695802:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789760769.695874:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789760769.695911:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789760769.695940:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789760769.695968:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789760769.696015:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789760769.696068:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789760769.698457:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789760769.698539:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1789760769.698598:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278208:0@lo:502: 00000100:00100000:1.0:1789760769.698706:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.698809:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760769.700032:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278208 00000100:00100000:0.0:1789760769.700045:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278208 00000100:00100000:0.0:1789760769.700199:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789760769.700210:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083278208:12345-0@lo:502: 00000100:00100000:0.0:1789760769.700647:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083278208:12345-0@lo:502: Request processed in 436us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.700655:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789760769.702046:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278208:0@lo:502: 00000040:00080000:1.0:1789760769.703063:0:8072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789760769.703084:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789760769.705555:0:8096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789760769.705575:0:8096:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff93308880cd28) 00000020:00000080:2.0:1789760769.705598:0:8096:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789760769.705701:0:8096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b4757000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789760769.705707:0:8096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9330b4757000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789760769.705709:0:8096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9330b4757000 3 00010000:00080000:2.0:1789760769.705744:0:8096:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f8488e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.153@tcp at head 00010000:00010000:2.0:1789760769.707398:0:8096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789760769.708234:0:8096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789760769.708275:0:8096:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789760769.708290:0:8096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x838c7b3c022b748a 00000100:00080000:2.0:1789760769.708303:0:8096:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789760769.708309:0:8096:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff932f8488e000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:2.0:1789760769.708352:0:8096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330bcab6680 x1876700083278336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789760769.708390:0:8096:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789760769.708452:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3427:1876700083278336:0@lo:38: 00000100:00100000:0.0:1789760769.708531:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789760769.708872:0:8096:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789760769.708888:0:8096:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff93309831cd28) 00000020:00000080:1.0:1789760769.708904:0:8096:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789760769.708984:0:8096:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b4757000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789760769.708989:0:8096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9330b4757000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789760769.708991:0:8096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9330b4757000 3 00010000:00080000:1.0:1789760769.709030:0:8096:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f8462f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1789760769.711576:0:8096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:2.0:1789760769.713602:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278336 00000100:00100000:2.0:1789760769.713626:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278336 00000020:00000080:0.0:1789760769.714291:0:8096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789760769.714336:0:8096:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760769.714348:0:8096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x838c7b3c022b7498 00000100:00080000:0.0:1789760769.714360:0:8096:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760769.714366:0:8096:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff932f8462f000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760769.714523:0:8096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330b3d3c700 x1876700083278464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760769.714550:0:8096:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789760769.714620:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760769.714632:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3427:x1876700083278336:12345-0@lo:38: 00010000:00080000:2.0:1789760769.714674:0:6430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:2.0:1789760769.714827:0:6430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x838c7b3c022b749f 00000004:00100000:2.0:1789760769.714847:0:6430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789760769.714887:0:6430:0:(import.c:65:import_set_state_nolock()) ffff9330907bf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760769.714978:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3427:x1876700083278336:12345-0@lo:38: Request processed in 346us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.714985:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760769.715784:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3427:1876700083278464:0@lo:38: 00000100:00100000:3.0:1789760769.715843:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789760769.715913:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9330bcab6680 x1876700083278336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760769.715924:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760769.715933:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789760769.715942:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789760769.715948:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789760769.715951:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f8488e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789760769.715959:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3427:1876700083278336:0@lo:38: 00000100:00100000:3.0:1789760769.716009:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278464 00000100:00100000:3.0:1789760769.716015:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278464 00000100:00100000:3.0:1789760769.716044:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760769.716051:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3427:x1876700083278464:12345-0@lo:38: 00010000:00080000:3.0:1789760769.716073:0:6431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:3.0:1789760769.716122:0:6431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x838c7b3c022b74a6 00000004:00100000:3.0:1789760769.716134:0:6431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789760769.716161:0:6431:0:(import.c:65:import_set_state_nolock()) ffff932f84639800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760769.716223:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3427:x1876700083278464:12345-0@lo:38: Request processed in 171us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760769.716231:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789760769.716270:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9330b3d3c700 x1876700083278464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760769.716278:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760769.716289:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789760769.716294:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789760769.716298:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789760769.716300:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f8462f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789760769.716304:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3427:1876700083278464:0@lo:38: 00000040:00080000:0.0:1789760769.718315:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789760769.718598:0:8072:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789760769.718625:0:8072:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760769.718649:0:8072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.718662:0:8072:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789760769.718716:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789760769.718719:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789760769.718721:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760769.718722:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760769.718724:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760769.718725:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760769.718727:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760769.718806:0:8072:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760769.718809:0:8072:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760769.718810:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760769.718812:0:8072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760769.718816:0:8072:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789760769.718819:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789760769.718820:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789760769.718822:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789760769.718823:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789760769.718824:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789760769.718825:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789760769.718827:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789760769.718828:0:8072:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789760769.718830:0:8072:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789760769.718838:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789760769.718839:0:8072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789760769.718879:0:8072:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789760769.718899:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278592:0@lo:253: 00000100:00100000:3.0:1789760769.718974:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760769.719018:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278592 00000100:00100000:3.0:1789760769.719027:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278592 00000100:00100000:3.0:1789760769.719083:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789760769.719095:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:8072:x1876700083278592:12345-0@lo:253: 20000000:01000000:3.0:1789760769.719126:0:6422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789760769.719140:0:6422:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789760769.720305:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff933083061300 going to sleep for 11 seconds 20000000:01000000:3.0:1789760769.759902:0:6422:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789760769.759924:0:6422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789760769.759982:0:6445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789760769.759987:0:6445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789760769.760011:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760031:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b739c expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760039:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760046:0:6445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760178:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760211:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 16 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.760226:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083278720:0@lo:104: 00000100:00100000:0.0:1789760769.760310:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760769.760395:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.760404:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 16 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.760412:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083278848:0@lo:104: 00000100:00100000:0.0:1789760769.760431:0:6445:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760769.760507:0:6414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789760769.760527:0:6414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760769.760576:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278720 00000100:00100000:1.0:1789760769.760585:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278720 00000100:00100000:1.0:1789760769.760623:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278848 00000100:00100000:1.0:1789760769.760625:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278848 00000100:00100000:1.0:1789760769.760637:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789760769.760646:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933088818c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083278720:12345-0@lo:104: 00010000:00010000:1.0:1789760769.760659:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760769.760712:0:6414:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1789760769.760720:0:6414:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789760769.761485:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789760769.761495:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083278848:12345-0@lo:104: 00010000:00010000:2.0:1789760769.761505:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761547:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760769.761553:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083278848:12345-0@lo:104: Request processed in 61us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.761560:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789760769.761581:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760769.761588:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761596:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330814f9600 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760769.761600:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761620:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760769.761627:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760769.761633:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760769.761676:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761682:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760769.761699:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761707:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330814f9600/0x838c7b3c022b739c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73a3 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760769.761718:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.761720:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760769.761722:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760769.762044:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083278720:0@lo:104: 00000100:00100000:3.0:1789760769.762054:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083278848:0@lo:104: 00010000:00010000:3.0:1789760769.762078:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762151:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789760769.762158:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933088818c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083278720:12345-0@lo:104: Request processed in 1512us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.762165:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789760769.762255:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760769.762261:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.762269:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933080030e00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760769.762273:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.762292:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760769.762299:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760769.762305:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760769.762322:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.762327:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789760769.762332:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083278976:0@lo:103: 00000100:00100000:1.0:1789760769.762372:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083279104:0@lo:103: 00000100:00100000:0.0:1789760769.762373:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.762419:0:7244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083278976 00000100:00100000:0.0:1789760769.762426:0:7244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083278976 00010000:00010000:0.0:1789760769.762448:0:7244:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 17 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.762449:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760769.762467:0:7244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279104 00000100:00100000:0.0:1789760769.762470:0:7244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279104 00010000:00010000:0.0:1789760769.762480:0:7244:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760769.762489:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.762495:0:7244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789760769.762496:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b73b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b73bf expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.762508:0:7244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+18:3431:x1876700083278976:12345-0@lo:103: 00010000:00010000:3.0:1789760769.762512:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760769.762513:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760769.762515:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760769.762518:0:7244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760769.762524:0:7244:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.762534:0:7244:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760769.762548:0:7244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330814f9000/0x838c7b3c022b73a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b739c expref: 18 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760769.762557:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789760769.762561:0:7244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760769.762564:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+17:3428:x1876700083279104:12345-0@lo:103: 00010000:00010000:1.0:1789760769.762571:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760769.762575:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 17 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762584:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 17 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762595:0:6416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459000/0x838c7b3c022b73bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b73b8 expref: 17 pid: 6422 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760769.762596:0:7244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+17:3431:x1876700083278976:12345-0@lo:103: Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760769.762602:0:7244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789760769.762607:0:6416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762615:0:6416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760769.762628:0:6416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003052623s 00010000:00010000:1.0:1789760769.762633:0:6416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762649:0:6416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762656:0:6416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762661:0:6416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762666:0:6416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7459a00 already unused, calling callback (ffffffffc1470350) 00010000:00010000:1.0:1789760769.762671:0:6416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762678:0:6416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762692:0:6416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762702:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760769.762729:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+15:3428:x1876700083279104:12345-0@lo:103: Request processed in 166us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760769.762735:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760769.762796:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083278976:0@lo:103: 00000100:00100000:1.0:1789760769.762883:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083279104:0@lo:103: 00010000:00010000:1.0:1789760769.762903:0:6445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762910:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760769.762926:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459a00/0x838c7b3c022b74ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760769.768291:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+14:8072:x1876700083278592:12345-0@lo:253: Request processed in 49187us (49306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760769.768309:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789760769.768452:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:8072:1876700083278592:0@lo:253: 10000000:01000000:0.0:1789760769.768472:0:8072:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789760769.768476:0:8072:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760769.768477:0:8072:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789760769.768478:0:8072:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760769.768480:0:8072:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789760769.768481:0:8072:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760769.768482:0:8072:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760769.768484:0:8072:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760769.768485:0:8072:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789760769.768487:0:8072:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789760769.768488:0:8072:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760769.768490:0:8072:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789760769.768507:0:8072:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760769.773735:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760769.773939:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760769.774238:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760769.774421:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760769.774619:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760769.774868:0:8072:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789760769.776937:0:8072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789760769.964875:0:8072:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789760769.964883:0:8072:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789760769.964922:0:8072:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789760769.964975:0:8072:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789760769.964990:0:8072:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789760769.965017:0:8072:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789760770.374393:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760771.399893:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760771.974521:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760771.975909:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083279232:0@lo:41: 00000100:00100000:1.0:1789760771.975993:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760771.987484:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279232 00000100:00100000:2.0:1789760771.987503:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279232 00000100:00100000:2.0:1789760771.987585:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789760771.987599:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083279232:12345-0@lo:41: 00000004:00000024:2.0:1789760771.987667:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789760771.987786:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083279232:12345-0@lo:41: Request processed in 190us (11792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760771.987794:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789760771.988009:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083279232:0@lo:41: 00010000:00010000:3.0:1789760772.422398:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789760773.126293:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760773.126300:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933099616800 from 30 10000000:01000000:0.0:1789760773.126306:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760773.126357:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.126370:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.126383:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.126408:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279360:0@lo:101: 00000100:00100000:0.0:1789760773.126477:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.126537:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330857accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.126752:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279360 00000100:00100000:1.0:1789760773.126761:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279360 00000100:00100000:1.0:1789760773.126854:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789760773.126865:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:6427:x1876700083279360:12345-0@lo:101: 00010000:00010000:1.0:1789760773.126883:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760773.126897:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b74b4 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.126926:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 15 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.126939:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 15 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.126949:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650000, rc 0) 00000100:00100000:1.0:1789760773.127003:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083279360:12345-0@lo:101: Request processed in 139us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.127020:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789760773.127107:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279360:0@lo:101: 00010000:00010000:3.0:1789760773.127124:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.127133:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.127218:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279488:0@lo:501: 00000100:00100000:3.0:1789760773.127245:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.127445:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.127491:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279488 00000100:00100000:0.0:1789760773.127497:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279488 00000100:00100000:0.0:1789760773.127531:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789760773.127538:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083279488:12345-0@lo:501: 00000100:00100000:0.0:1789760773.128216:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083279488:12345-0@lo:501: Request processed in 675us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.128224:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789760773.130207:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279488:0@lo:501: 00000100:00100000:3.0:1789760773.130284:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279616:0@lo:503: 00000100:00100000:3.0:1789760773.130352:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.130386:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.130864:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279616 00000100:00100000:0.0:1789760773.130873:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279616 00000100:00100000:0.0:1789760773.130932:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789760773.130942:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083279616:12345-0@lo:503: 00000100:00100000:0.0:1789760773.131680:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083279616:12345-0@lo:503: Request processed in 735us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.131690:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789760773.135271:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083279616:0@lo:503: 00000100:00100000:1.0:1789760773.138057:0:8303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8303:1876700083279744:0@lo:502: 00000100:00100000:1.0:1789760773.138150:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.138218:0:8303:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082da4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760773.138287:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279744 00000100:00100000:3.0:1789760773.138298:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279744 00000100:00100000:3.0:1789760773.138352:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789760773.138362:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:8303:x1876700083279744:12345-0@lo:502: 00000100:00100000:3.0:1789760773.138714:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:8303:x1876700083279744:12345-0@lo:502: Request processed in 352us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760773.138723:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789760773.139046:0:8303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8303:1876700083279744:0@lo:502: 00000100:00100000:0.0:1789760773.139104:0:8303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8303:1876700083279872:0@lo:502: 00000100:00100000:0.0:1789760773.139142:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.139195:0:8303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330857accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760773.139322:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083279872 00000100:00100000:3.0:1789760773.139328:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083279872 00000100:00100000:3.0:1789760773.139364:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789760773.139372:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:8303:x1876700083279872:12345-0@lo:502: 00000100:00100000:3.0:1789760773.139511:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:8303:x1876700083279872:12345-0@lo:502: Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760773.139517:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789760773.139645:0:8303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8303:1876700083279872:0@lo:502: 00000040:00080000:0.0:1789760773.139665:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789760773.139924:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789760773.139943:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789760773.139961:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.139973:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760773.139982:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789760773.139985:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933099616800 from 5 10000000:01000000:3.0:1789760773.139988:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789760773.140019:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.140028:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.140038:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.140052:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280000:0@lo:101: 00000100:00100000:3.0:1789760773.140083:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.140112:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.140174:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280000 00000100:00100000:1.0:1789760773.140199:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280000 00000100:00100000:1.0:1789760773.140233:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789760773.140240:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:6427:x1876700083280000:12345-0@lo:101: 00010000:00010000:1.0:1789760773.140250:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760773.140264:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b74c2 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.140288:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 16 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.140298:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 16 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.140307:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081651400, rc 0) 00000100:00100000:1.0:1789760773.140337:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083280000:12345-0@lo:101: Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.140342:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789760773.140472:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280000:0@lo:101: 00010000:00010000:3.0:1789760773.140485:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.140493:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.140537:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280128:0@lo:256: 00000100:00100000:3.0:1789760773.140787:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.140933:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.141096:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280128 00000100:00100000:1.0:1789760773.141102:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280128 00000100:00100000:1.0:1789760773.141141:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789760773.141149:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083280128:12345-0@lo:256: 20000000:01000000:1.0:1789760773.141166:0:6425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789760773.141213:0:6425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789760773.141222:0:6425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789760773.141313:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083280128:12345-0@lo:256: Request processed in 165us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.141321:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789760773.141469:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280128:0@lo:256: 10000000:01000000:3.0:1789760773.141515:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789760773.141522:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.141531:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760773.141539:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789760773.141542:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789760773.141544:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789760773.141649:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.141657:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.141666:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.141761:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280256:0@lo:101: 00000100:00100000:3.0:1789760773.141918:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.141990:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.142028:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280256 00000100:00100000:1.0:1789760773.142032:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280256 00000100:00100000:1.0:1789760773.142095:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789760773.142103:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083280256:12345-0@lo:101: 00010000:00010000:1.0:1789760773.142113:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760773.142125:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b74d0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.142146:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.142157:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.142167:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650400, rc 0) 00000100:00100000:1.0:1789760773.142227:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083280256:12345-0@lo:101: Request processed in 124us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.142233:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789760773.142306:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280256:0@lo:101: 00010000:00010000:3.0:1789760773.142319:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760773.142339:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.142392:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280384:0@lo:501: 00000100:00100000:3.0:1789760773.142420:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.142559:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.142587:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280384 00000100:00100000:0.0:1789760773.142591:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280384 00000100:00100000:0.0:1789760773.142613:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789760773.142619:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083280384:12345-0@lo:501: 00000100:00100000:0.0:1789760773.143140:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083280384:12345-0@lo:501: Request processed in 518us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.143147:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789760773.143376:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280384:0@lo:501: 00000100:00100000:3.0:1789760773.143414:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280512:0@lo:503: 00000100:00100000:3.0:1789760773.143454:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.143559:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.143630:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280512 00000100:00100000:0.0:1789760773.143635:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280512 00000100:00100000:0.0:1789760773.143746:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789760773.143754:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083280512:12345-0@lo:503: 00000100:00100000:0.0:1789760773.144153:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083280512:12345-0@lo:503: Request processed in 399us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.144159:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789760773.144262:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083280512:0@lo:503: 00000100:00100000:3.0:1789760773.144658:0:8304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8304:1876700083280640:0@lo:502: 00000100:00100000:3.0:1789760773.144758:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.144908:0:8304:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0780 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.144940:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280640 00000100:00100000:0.0:1789760773.144945:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280640 00000100:00100000:0.0:1789760773.145004:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789760773.145019:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:8304:x1876700083280640:12345-0@lo:502: 00000100:00100000:0.0:1789760773.145315:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:8304:x1876700083280640:12345-0@lo:502: Request processed in 296us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.145322:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789760773.145411:0:8304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8304:1876700083280640:0@lo:502: 00000020:01000000:3.0:1789760773.145433:0:8304:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789760773.145439:0:8304:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt2/mdt2 00000020:00000080:3.0:1789760773.145445:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760773.145448:0:8304:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789760773.145451:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789760773.145455:0:8304:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:3.0:1789760773.145474:0:8304:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789760773.145477:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789760773.145489:0:8304:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9330ad6719b8) 00000020:00000080:3.0:1789760773.145509:0:8304:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1789760773.145517:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789760773.145657:0:8304:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789760773.145664:0:8304:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789760773.145671:0:8304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b74e5 00010000:00080000:3.0:1789760773.145769:0:8304:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933082caf000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.153@tcp at head 00010000:00010000:3.0:1789760773.146049:0:8304:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789760773.187629:0:8304:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789760773.187651:0:8304:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789760773.188167:0:8304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760773.188366:0:8304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760773.188414:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789760773.188472:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789760773.189464:0:8307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789760773.189469:0:8307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789760773.190764:0:8304:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789760773.190777:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789760773.190812:0:8304:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789760773.190834:0:8304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b74ec 00000100:00080000:0.0:1789760773.190845:0:8304:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760773.190852:0:8304:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff933082caf000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760773.190893:0:8304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330b3d3df80 x1876700083280768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760773.190922:0:8304:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789760773.190991:0:8304:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760773.190995:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760773.190997:0:8304:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789760773.191000:0:8304:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760773.191003:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760773.191005:0:8304:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760773.191007:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760773.191009:0:8304:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789760773.191025:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3430:1876700083280896:0@lo:400: 00000100:00100000:0.0:1789760773.191031:0:8304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8304:1876700083281664:0@lo:502: 00000100:00100000:2.0:1789760773.191092:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.191152:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.191217:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083280768:0@lo:8: 00000100:00100000:3.0:1789760773.191262:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191324:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3430:1876700083281408:0@lo:400: 00000100:00100000:2.0:1789760773.191352:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191376:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789760773.191382:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083281024:0@lo:400: 00000100:00100000:2.0:1789760773.191417:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191483:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3430:1876700083281536:0@lo:400: 00000100:00100000:2.0:1789760773.191508:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191534:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083281152:0@lo:400: 00000100:00100000:2.0:1789760773.191554:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191566:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789760773.191570:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bcab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083281280:0@lo:400: 00000100:00100000:2.0:1789760773.191588:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760773.191672:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280896 00000100:00100000:2.0:1789760773.191680:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280896 00000100:00100000:2.0:1789760773.191713:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281408 00000100:00100000:2.0:1789760773.191715:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281408 00000100:00100000:2.0:1789760773.191750:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281536 00000100:00100000:2.0:1789760773.191754:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281536 00000100:00100000:2.0:1789760773.191764:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281152 00000100:00100000:2.0:1789760773.191767:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281152 00000100:00100000:2.0:1789760773.191780:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760773.191789:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bcab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3430:x1876700083280896:12345-0@lo:400: 00000100:00100000:2.0:1789760773.191849:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bcab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3430:x1876700083280896:12345-0@lo:400: Request processed in 60us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.191858:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789760773.191873:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760773.191879:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bcab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3430:x1876700083281408:12345-0@lo:400: 00000100:00100000:2.0:1789760773.191903:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bcab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3430:x1876700083281408:12345-0@lo:400: Request processed in 24us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.191909:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789760773.191918:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760773.191923:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3430:x1876700083281536:12345-0@lo:400: 00000100:00100000:2.0:1789760773.191945:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3430:x1876700083281536:12345-0@lo:400: Request processed in 22us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.191951:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789760773.191959:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760773.191965:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083281152:12345-0@lo:400: 00000100:00100000:2.0:1789760773.191988:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083281152:12345-0@lo:400: Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.191994:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760773.192013:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083280768 00000100:00100000:2.0:1789760773.192017:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083280768 00000100:00100000:2.0:1789760773.192034:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760773.192039:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3427:x1876700083280768:12345-0@lo:8: 00010000:00080000:2.0:1789760773.192061:0:8074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1789760773.192084:0:8074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b74f3 00002000:00100000:2.0:1789760773.192121:0:8074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9330bd085800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789760773.192133:0:8074:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789760773.192137:0:8074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789760773.192343:0:8074:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789760773.192494:0:8074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789760773.192519:0:8074:0:(import.c:65:import_set_state_nolock()) ffff9330bd081000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760773.192560:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3427:x1876700083280768:12345-0@lo:8: Request processed in 519us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760773.192567:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760773.192631:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281024 00000100:00100000:1.0:1789760773.192636:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281024 00000100:00100000:1.0:1789760773.192664:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281280 00000100:00100000:1.0:1789760773.192667:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281280 00000100:00100000:1.0:1789760773.192680:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760773.192686:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083281024:12345-0@lo:400: 00000100:00100000:1.0:1789760773.192734:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083281024:12345-0@lo:400: Request processed in 37us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.192748:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789760773.192762:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789760773.192767:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083281280:12345-0@lo:400: 00000100:00100000:1.0:1789760773.192796:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083281280:12345-0@lo:400: Request processed in 29us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.192802:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789760773.192857:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789760773.192861:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760773.192896:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083281280:0@lo:400: 00010000:00080000:2.0:1789760773.192909:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bcab6a00 x1876700083281152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760773.192920:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083281152:0@lo:400: 00000100:00100000:2.0:1789760773.192948:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083281024:0@lo:400: 00010000:00080000:2.0:1789760773.192958:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bcab5c00 x1876700083281536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760773.192967:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3430:1876700083281536:0@lo:400: 00010000:00080000:2.0:1789760773.192978:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bcab7100 x1876700083280896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760773.192987:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3430:1876700083280896:0@lo:400: 00010000:00080000:2.0:1789760773.192998:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bcab6300 x1876700083281408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760773.193005:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bcab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3430:1876700083281408:0@lo:400: 00000100:00100000:0.0:1789760773.193120:0:8304:0:(client.c:2715:ptlrpc_set_wait()) set ffff933098070900 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.193138:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281664 00000100:00100000:0.0:1789760773.193142:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281664 00000100:00100000:0.0:1789760773.193178:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789760773.194701:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:8304:x1876700083281664:12345-0@lo:502: 00000100:00100000:0.0:1789760773.195038:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:8304:x1876700083281664:12345-0@lo:502: Request processed in 351us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.195047:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1789760773.195421:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3df80 x1876700083280768/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760773.195433:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789760773.195444:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789760773.195453:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789760773.195459:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789760773.195463:0:3427:0:(import.c:65:import_set_state_nolock()) ffff933082caf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789760773.195487:0:3427:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789760773.195495:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083280768:0@lo:8: 00000100:00100000:2.0:1789760773.195609:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083281792:0@lo:700: 00000100:00100000:2.0:1789760773.195654:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.195807:0:8304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8304:1876700083281664:0@lo:502: 00000020:01000000:1.0:1789760773.195836:0:8304:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760773.195844:0:8304:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760773.195846:0:8304:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789760773.195851:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789760773.196096:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789760773.196112:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789760773.196123:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.196134:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760773.196142:0:8083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281792 10000000:01000000:1.0:1789760773.196145:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 00000100:00100000:2.0:1789760773.196148:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b40d6600 going to sleep for 11 seconds 10000000:01000000:1.0:1789760773.196149:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933087a7b000 from 30 00000100:00100000:3.0:1789760773.196151:0:8083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281792 10000000:01000000:1.0:1789760773.196155:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760773.196206:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789760773.196207:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789760773.196217:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.196227:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.196247:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083281920:0@lo:101: 00000100:00100000:2.0:1789760773.196269:0:8083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789760773.196281:0:8083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8308:x1876700083281792:12345-0@lo:700: 00000100:00100000:1.0:1789760773.196284:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.196311:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083281920 00000100:00100000:0.0:1789760773.196317:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083281920 00000100:00100000:1.0:1789760773.196317:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852e4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760773.196322:0:8083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8083:1876700083282048:0@lo:700: 00000100:00100000:0.0:1789760773.196346:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760773.196357:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083281920:12345-0@lo:101: 00000100:00100000:2.0:1789760773.196364:0:8083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760773.196370:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760773.196390:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b74fa expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760773.196398:0:8083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b40d6b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789760773.196417:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.196430:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760773.196432:0:8307:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:0.0:1789760773.196443:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330a7459600, rc 0) 00000100:00100000:0.0:1789760773.196484:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083281920:12345-0@lo:101: Request processed in 130us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.196491:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789760773.196533:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083281920:0@lo:101: 00010000:00010000:0.0:1789760773.196553:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.196563:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789760773.196599:0:8307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 160421417348ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789760773.196620:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282176:0@lo:501: 00000100:00100000:0.0:1789760773.196653:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.196670:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.196688:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282176 00000100:00100000:0.0:1789760773.196692:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282176 00000100:00100000:0.0:1789760773.196720:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789760773.196741:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083282176:12345-0@lo:501: 00000100:00100000:0.0:1789760773.196968:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083282176:12345-0@lo:501: Request processed in 229us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.196975:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789760773.197002:0:6436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282048 00000100:00100000:1.0:1789760773.197008:0:6436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282048 00000100:00100000:0.0:1789760773.197011:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282176:0@lo:501: 00000100:00100000:0.0:1789760773.197042:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282304:0@lo:503: 00000100:00100000:0.0:1789760773.197079:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.197092:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.197104:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282304 00000100:00100000:0.0:1789760773.197108:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282304 00000100:00100000:0.0:1789760773.197127:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789760773.197135:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083282304:12345-0@lo:503: 00000100:00100000:0.0:1789760773.197396:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083282304:12345-0@lo:503: Request processed in 261us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.197402:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789760773.197452:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282304:0@lo:503: 00000100:00100000:1.0:1789760773.197884:0:6436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760773.197894:0:6436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8083:x1876700083282048:12345-0@lo:700: 00000100:00100000:0.0:1789760773.200620:0:8309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8309:1876700083282432:0@lo:502: 00000100:00100000:0.0:1789760773.202044:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.202090:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282432 00000100:00100000:0.0:1789760773.202099:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282432 00000100:00100000:0.0:1789760773.202161:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789760773.202175:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:8309:x1876700083282432:12345-0@lo:502: 00000100:00100000:0.0:1789760773.203546:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:8309:x1876700083282432:12345-0@lo:502: Request processed in 1368us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.203558:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789760773.203622:0:8309:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.203653:0:8309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8309:1876700083282432:0@lo:502: 00000100:00100000:0.0:1789760773.203746:0:8309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8309:1876700083282560:0@lo:502: 00000100:00100000:0.0:1789760773.203794:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.203830:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282560 00000100:00100000:0.0:1789760773.203836:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282560 00000100:00100000:0.0:1789760773.203873:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789760773.203883:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:8309:x1876700083282560:12345-0@lo:502: 00000100:00100000:0.0:1789760773.204207:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+18:8309:x1876700083282560:12345-0@lo:502: Request processed in 324us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.204214:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789760773.204251:0:8309:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082da5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.204265:0:8309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8309:1876700083282560:0@lo:502: 00000040:00080000:0.0:1789760773.204289:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789760773.204382:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789760773.204416:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760773.204428:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204440:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760773.204451:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760773.204454:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933087a7b000 from 5 10000000:01000000:0.0:1789760773.204458:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760773.204488:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204496:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204506:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.204518:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282688:0@lo:101: 00000100:00100000:0.0:1789760773.204551:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.204577:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082da5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.204595:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282688 00000100:00100000:0.0:1789760773.204599:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282688 00000100:00100000:0.0:1789760773.204629:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789760773.204638:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083282688:12345-0@lo:101: 00010000:00010000:0.0:1789760773.204649:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760773.204663:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7508 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204694:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 19 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204703:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 19 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204710:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330a7458e00, rc 0) 00000100:00100000:0.0:1789760773.204753:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083282688:12345-0@lo:101: Request processed in 117us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.204759:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789760773.204798:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282688:0@lo:101: 00010000:00010000:0.0:1789760773.204811:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.204821:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.204870:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282816:0@lo:256: 00000100:00100000:0.0:1789760773.204898:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.204910:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082da5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.204922:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282816 00000100:00100000:0.0:1789760773.204925:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282816 00000100:00100000:0.0:1789760773.204946:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789760773.204952:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083282816:12345-0@lo:256: 20000000:01000000:0.0:1789760773.205045:0:6425:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789760773.205065:0:6425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789760773.205068:0:6425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789760773.205147:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083282816:12345-0@lo:256: Request processed in 194us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.205155:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789760773.205201:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282816:0@lo:256: 10000000:01000000:0.0:1789760773.205239:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760773.205245:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205252:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760773.205259:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789760773.205261:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789760773.205263:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760773.205279:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205285:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205292:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.205302:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282944:0@lo:101: 00000100:00100000:0.0:1789760773.205325:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.205338:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082da5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.205349:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083282944 00000100:00100000:0.0:1789760773.205352:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083282944 00000100:00100000:0.0:1789760773.205372:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789760773.205378:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083282944:12345-0@lo:101: 00010000:00010000:0.0:1789760773.205390:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760773.205399:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7516 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205413:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 20 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205421:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 20 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205428:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330a7458600, rc 0) 00000100:00100000:0.0:1789760773.205459:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083282944:12345-0@lo:101: Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.205465:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789760773.205499:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083282944:0@lo:101: 00010000:00010000:0.0:1789760773.205511:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760773.205519:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760773.205571:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283072:0@lo:501: 00000100:00100000:0.0:1789760773.205599:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.205618:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.205631:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283072 00000100:00100000:0.0:1789760773.205635:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283072 00000100:00100000:0.0:1789760773.205658:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789760773.205664:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083283072:12345-0@lo:501: 00000100:00100000:0.0:1789760773.205882:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083283072:12345-0@lo:501: Request processed in 218us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.205890:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789760773.205926:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283072:0@lo:501: 00000100:00100000:0.0:1789760773.206029:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283200:0@lo:503: 00000100:00100000:0.0:1789760773.206069:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.206084:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330830bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.206097:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283200 00000100:00100000:0.0:1789760773.206101:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283200 00000100:00100000:0.0:1789760773.206124:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789760773.206131:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083283200:12345-0@lo:503: 00000100:00100000:0.0:1789760773.206442:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083283200:12345-0@lo:503: Request processed in 311us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.206449:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789760773.206491:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283200:0@lo:503: 00000100:00100000:1.0:1789760773.207662:0:8313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8313:1876700083283328:0@lo:502: 00000100:00100000:1.0:1789760773.207837:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.207878:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283328 00000100:00100000:1.0:1789760773.207886:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283328 00000100:00100000:1.0:1789760773.207932:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789760773.207942:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:8313:x1876700083283328:12345-0@lo:502: 00000100:00100000:1.0:1789760773.208426:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:8313:x1876700083283328:12345-0@lo:502: Request processed in 486us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.208435:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789760773.208491:0:8313:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852e4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.208514:0:8313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8313:1876700083283328:0@lo:502: 00000020:01000000:1.0:1789760773.208551:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789760773.208561:0:8313:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789760773.208567:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760773.208570:0:8313:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789760773.208575:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789760773.208579:0:8313:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:1.0:1789760773.208601:0:8313:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789760773.208604:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789760773.208624:0:8313:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff93309831b370) 00000020:00000080:1.0:1789760773.208644:0:8313:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789760773.208649:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789760773.208721:0:8313:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789760773.208742:0:8313:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789760773.208750:0:8313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b752b 00010000:00080000:1.0:1789760773.208785:0:8313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f84888000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.153@tcp at head 00010000:00010000:1.0:1789760773.209068:0:8313:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:0.0:1789760773.236585:0:7235:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1789760773.237127:0:6436:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789760773.246794:0:6436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8083:x1876700083282048:12345-0@lo:700: Request processed in 48893us (50424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.246809:0:6436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789760773.246891:0:8083:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933087c95880 x1876700083282048/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.246908:0:8083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c95880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8083:1876700083282048:0@lo:700: 40000000:02000000:1.0:1789760773.246923:0:8083:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789760773.271394:0:8313:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789760773.271417:0:8313:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789760773.271932:0:8313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760773.272239:0:8313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760773.272285:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789760773.272345:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789760773.279943:0:8321:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789760773.279951:0:8321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789760773.288418:0:8313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789760773.288433:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789760773.288473:0:8313:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789760773.288495:0:8313:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b7532 00000100:00080000:0.0:1789760773.288507:0:8313:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760773.288518:0:8313:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff932f84888000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760773.288559:0:8313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330b3d3fb80 x1876700083283456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760773.288583:0:8313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789760773.288634:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760773.288638:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760773.288639:0:8313:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789760773.288642:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760773.288645:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760773.288647:0:8313:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760773.288649:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760773.288651:0:8313:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789760773.288678:0:8313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8313:1876700083283584:0@lo:502: 00000100:00100000:0.0:1789760773.288763:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.288802:0:8313:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5c64540 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.288821:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083283456:0@lo:8: 00000100:00100000:0.0:1789760773.288861:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.288907:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283584 00000100:00100000:0.0:1789760773.288915:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283584 00000100:00100000:0.0:1789760773.288958:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789760773.288968:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:8313:x1876700083283584:12345-0@lo:502: 00000100:00100000:0.0:1789760773.290834:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:8313:x1876700083283584:12345-0@lo:502: Request processed in 1858us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.290847:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789760773.290910:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283456 00000100:00100000:0.0:1789760773.290919:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283456 00000100:00100000:0.0:1789760773.290947:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789760773.290953:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3427:x1876700083283456:12345-0@lo:8: 00010000:00080000:0.0:1789760773.290992:0:8077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1789760773.291022:0:8077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b7539 00002000:00100000:0.0:1789760773.291037:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9330b5dae800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789760773.291041:0:8077:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789760773.291146:0:8077:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789760773.291357:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789760773.291384:0:8077:0:(import.c:65:import_set_state_nolock()) ffff9330b5e0e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760773.291432:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3427:x1876700083283456:12345-0@lo:8: Request processed in 478us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760773.291439:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789760773.291484:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3fb80 x1876700083283456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.291496:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760773.291504:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789760773.291512:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789760773.291517:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789760773.291520:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f84888000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789760773.291529:0:3427:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789760773.291534:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083283456:0@lo:8: 00000100:00100000:0.0:1789760773.291568:0:8313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:8313:1876700083283584:0@lo:502: 00000020:01000000:0.0:1789760773.291596:0:8313:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760773.291602:0:8313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760773.291605:0:8313:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760773.291609:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:0.0:1789760773.291716:0:8321:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789760773.291820:0:8321:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 160516638105ns, next at 0ns, rc = 0 00000020:01000000:1.0:1789760773.293357:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789760773.293386:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789760773.293399:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293411:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760773.293420:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789760773.293422:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93309ea30000 from 1 10000000:01000000:1.0:1789760773.293425:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789760773.293464:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293478:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293491:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.293516:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283712:0@lo:101: 00000100:00100000:1.0:1789760773.293580:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.293616:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090796e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.293708:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283712 00000100:00100000:1.0:1789760773.293715:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283712 00000100:00100000:1.0:1789760773.293774:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789760773.293785:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083283712:12345-0@lo:101: 00010000:00010000:1.0:1789760773.293800:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760773.293812:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7540 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293838:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293849:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293858:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650c00, rc 0) 00000100:00100000:1.0:1789760773.293896:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083283712:12345-0@lo:101: Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.293902:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789760773.293949:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283712:0@lo:101: 00010000:00010000:1.0:1789760773.293970:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.293980:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.294027:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283840:0@lo:501: 00000100:00100000:1.0:1789760773.296815:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.296861:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090796e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.296884:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283840 00000100:00100000:1.0:1789760773.296893:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283840 00000100:00100000:1.0:1789760773.296943:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789760773.296954:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083283840:12345-0@lo:501: 00000100:00100000:1.0:1789760773.297177:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083283840:12345-0@lo:501: Request processed in 224us (369us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760773.297383:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789760773.297438:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083283840:0@lo:501: 10000000:01000000:1.0:1789760773.297476:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789760773.297485:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760773.297496:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760773.306069:0:8083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8308:x1876700083281792:12345-0@lo:700: Request processed in 109781us (110405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.306087:0:8083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:1.0:1789760773.306134:0:8103:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1789760773.306200:0:8308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933087c95c00 x1876700083281792/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.306217:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083281792:0@lo:700: 00000004:00080000:0.0:1789760773.342387:0:6451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789760773.356301:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083283968:0@lo:13: 00000100:00100000:3.0:1789760773.356380:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.357949:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083283968 00000100:00100000:1.0:1789760773.357962:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083283968 00000100:00100000:1.0:1789760773.358021:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789760773.358032:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083283968:12345-0@lo:13: 00002000:00000024:1.0:1789760773.358073:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789760773.358140:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083283968:12345-0@lo:13: Request processed in 109us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.358148:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789760773.358160:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845b9880 x1876700083283968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789760773.358168:0:8308:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789760773.358197:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083283968:0@lo:13: 00000100:00100000:1.0:1789760773.358216:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284096:0@lo:7: 00000100:00100000:1.0:1789760773.358249:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.358272:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090796600 going to sleep for 11 seconds 00000100:00100000:3.0:1789760773.358976:0:8076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284096 00000100:00100000:3.0:1789760773.358988:0:8076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284096 00000100:00100000:3.0:1789760773.359019:0:8076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760773.359027:0:8076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8308:x1876700083284096:12345-0@lo:7: 00000004:00080000:0.0:1789760773.370685:0:8324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789760773.370734:0:8324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284352:0@lo:7: 00000100:00100000:0.0:1789760773.370930:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.370966:0:8324:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082cf4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.371011:0:8074:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760773.371020:0:8074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789760773.371824:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083284224:0@lo:13: 00000100:00100000:1.0:1789760773.371873:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.371922:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284224 00000100:00100000:1.0:1789760773.371931:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284224 00000100:00100000:1.0:1789760773.371987:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760773.371997:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3429:x1876700083284224:12345-0@lo:13: 00002000:00000024:1.0:1789760773.372024:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789760773.372070:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3429:x1876700083284224:12345-0@lo:13: Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.372076:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789760773.372107:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789760773.372141:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3d880 x1876700083284224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.372163:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083284224:0@lo:13: 00002000:00080000:1.0:1789760773.372274:0:8076:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789760773.372280:0:8076:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789760773.372316:0:8076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8308:x1876700083284096:12345-0@lo:7: Request processed in 13289us (14066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.372326:0:8076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789760773.372354:0:8308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845bb480 x1876700083284096/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.372365:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284096:0@lo:7: 00000004:00080000:1.0:1789760773.372375:0:8308:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789760773.372402:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284480:0@lo:5: 00000100:00100000:1.0:1789760773.372424:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.372439:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.372450:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284352 00000100:00100000:1.0:1789760773.372454:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284352 00000100:00100000:1.0:1789760773.372469:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284480 00000100:00100000:1.0:1789760773.372472:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284480 00000100:00100000:1.0:1789760773.372484:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760773.372490:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8324:x1876700083284352:12345-0@lo:7: 00000100:00100000:3.0:1789760773.373430:0:8335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760773.373445:0:8335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8308:x1876700083284480:12345-0@lo:5: 00002000:00080000:3.0:1789760773.373469:0:8335:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789760773.373558:0:8335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8308:x1876700083284480:12345-0@lo:5: Request processed in 118us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760773.373565:0:8335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760773.376873:0:8308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845bb480 x1876700083284480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.376894:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284480:0@lo:5: 00000004:00080000:0.0:1789760773.376912:0:8308:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789760773.376965:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284608:0@lo:5: 00000100:00100000:0.0:1789760773.377028:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.377074:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082cf4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760773.377101:0:8076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284608 00000100:00100000:0.0:1789760773.377108:0:8076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284608 00000100:00100000:0.0:1789760773.377158:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789760773.377168:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8308:x1876700083284608:12345-0@lo:5: 00002000:00080000:0.0:1789760773.377228:0:8074:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789760773.379702:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8308:x1876700083284608:12345-0@lo:5: Request processed in 2528us (2667us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789760773.379714:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789760773.381877:0:8308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3ce00 x1876700083284608/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.381899:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8308:1876700083284608:0@lo:5: 00000004:00080000:0.0:1789760773.381915:0:8308:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1789760773.381961:0:8308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8308:1876700083284736:0@lo:900: 00000100:00100000:0.0:1789760773.382026:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760773.382113:0:8308:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082cf4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760773.382170:0:6441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284736 00000100:00100000:3.0:1789760773.382270:0:6441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284736 00000100:00100000:3.0:1789760773.382315:0:6441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760773.382325:0:6441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8308:x1876700083284736:12345-0@lo:900: 00000100:00100000:3.0:1789760773.382379:0:6441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8308:x1876700083284736:12345-0@lo:900: Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760773.382386:0:6441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789760773.384981:0:8308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3c700 x1876700083284736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.385000:0:8308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8308:1876700083284736:0@lo:900: 00002000:00080000:1.0:1789760773.386313:0:8077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789760773.386320:0:8077:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789760773.386411:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8324:x1876700083284352:12345-0@lo:7: Request processed in 13917us (15479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.386421:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789760773.386475:0:8324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3fb80 x1876700083284352/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.386495:0:8324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284352:0@lo:7: 00000004:00080000:1.0:1789760773.386507:0:8324:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789760773.386551:0:8324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284864:0@lo:5: 00000100:00100000:1.0:1789760773.386589:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.386612:0:8324:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861f9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.386633:0:8335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284864 00000100:00100000:1.0:1789760773.386640:0:8335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284864 00000100:00100000:1.0:1789760773.386683:0:8335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760773.386693:0:8335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8324:x1876700083284864:12345-0@lo:5: 00002000:00080000:1.0:1789760773.386737:0:8335:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789760773.386741:0:8335:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789760773.386970:0:8335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8324:x1876700083284864:12345-0@lo:5: Request processed in 278us (380us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789760773.386977:0:8335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789760773.387006:0:8324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845bb100 x1876700083284864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760773.387018:0:8324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284864:0@lo:5: 00000004:00080000:1.0:1789760773.387027:0:8324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789760773.387054:0:8324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284992:0@lo:700: 00000100:00100000:1.0:1789760773.387083:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760773.387101:0:8324:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861f9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760773.387116:0:8084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083284992 00000100:00100000:1.0:1789760773.387119:0:8084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083284992 00000100:00100000:1.0:1789760773.387144:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789760773.387150:0:8084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8324:x1876700083284992:12345-0@lo:700: 00010000:00010000:3.0:1789760773.446851:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760773.475022:0:8084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8324:x1876700083284992:12345-0@lo:700: Request processed in 87862us (87928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760773.475046:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1789760773.475098:0:8103:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789760773.475109:0:8103:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789760773.475117:0:8103:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00080000:2.0:1789760773.475800:0:8324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845bad80 x1876700083284992/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760773.475819:0:8324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083284992:0@lo:700: 00000004:02000040:2.0:1789760773.506365:0:8324:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1789760773.512471:0:8324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083285120:0@lo:5: 00000100:00100000:3.0:1789760773.512560:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760773.512613:0:8076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285120 00000100:00100000:3.0:1789760773.512621:0:8076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285120 00000100:00100000:3.0:1789760773.512685:0:8076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760773.512697:0:8076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8324:x1876700083285120:12345-0@lo:5: 00000100:00100000:2.0:1789760773.516369:0:8324:0:(client.c:2715:ptlrpc_set_wait()) set ffff933082cf73c0 going to sleep for 11 seconds 00002000:00080000:0.0:1789760773.521412:0:8076:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789760773.521436:0:8076:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1789760773.525882:0:8076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8324:x1876700083285120:12345-0@lo:5: Request processed in 13179us (13315us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789760773.525897:0:8076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789760773.525970:0:8324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bd507480 x1876700083285120/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760789 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.525986:0:8324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789760773.526002:0:8324:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9330bd507480 x1876700083285120/t4294967299(4294967299) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760789 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760773.526013:0:8324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8324:1876700083285120:0@lo:5: 00000004:00080000:0.0:1789760773.526028:0:8324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1789760774.025358:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083285248:0@lo:41: 00000100:00100000:3.0:1789760774.025443:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760774.031929:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285248 00000100:00100000:1.0:1789760774.031945:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285248 00000100:00100000:1.0:1789760774.032017:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789760774.032026:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bd505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083285248:12345-0@lo:41: 00000004:00000024:1.0:1789760774.032069:0:6434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:1.0:1789760774.032290:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bd505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083285248:12345-0@lo:41: Request processed in 264us (6847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760774.032297:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760774.036218:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083285248:0@lo:41: 00010000:00010000:0.0:1789760774.474117:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789760774.758873:0:8453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789760775.494419:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760776.519984:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760777.095120:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083285376:0@lo:41: 00000100:00100000:2.0:1789760777.095236:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760777.095379:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285376 00000100:00100000:1.0:1789760777.095402:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285376 00000100:00100000:1.0:1789760777.095457:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789760777.095469:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083285376:12345-0@lo:41: 00000004:00000024:1.0:1789760777.095516:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789760777.095572:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083285376:12345-0@lo:41: Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760777.095580:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789760777.095830:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083285376:0@lo:41: 00010000:00010000:0.0:1789760777.543073:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760778.566974:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760778.631387:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083285504:0@lo:400: 00000100:00100000:3.0:1789760778.631465:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631520:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083286016:0@lo:400: 00000100:00100000:3.0:1789760778.631547:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631567:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083286528:0@lo:400: 00000100:00100000:3.0:1789760778.631591:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631617:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789760778.631624:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083285632:0@lo:400: 00000100:00100000:3.0:1789760778.631648:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631666:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083286144:0@lo:400: 00000100:00100000:3.0:1789760778.631696:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631724:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083285760:0@lo:400: 00000100:00100000:3.0:1789760778.631746:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631762:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3430:1876700083286272:0@lo:400: 00000100:00100000:3.0:1789760778.631782:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631799:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760778.631804:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083285888:0@lo:400: 00000100:00100000:3.0:1789760778.631826:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631836:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083286400:0@lo:400: 00000100:00100000:3.0:1789760778.631855:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760778.631922:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285504 00000100:00100000:3.0:1789760778.631931:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285504 00000100:00100000:3.0:1789760778.631986:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789760778.631996:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+21:3428:x1876700083285504:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632061:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+21:3428:x1876700083285504:12345-0@lo:400: Request processed in 66us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632069:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789760778.632103:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286016 00000100:00100000:3.0:1789760778.632107:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286016 00000100:00100000:3.0:1789760778.632129:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285760 00000100:00100000:3.0:1789760778.632131:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285760 00000100:00100000:3.0:1789760778.632144:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760778.632150:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083286016:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632204:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083286016:12345-0@lo:400: Request processed in 53us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632210:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760778.632221:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760778.632227:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083285760:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632257:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083285760:12345-0@lo:400: Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632262:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760778.632278:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286528 00000100:00100000:3.0:1789760778.632281:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286528 00000100:00100000:3.0:1789760778.632313:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286400 00000100:00100000:3.0:1789760778.632316:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286400 00000100:00100000:3.0:1789760778.632337:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760778.632343:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3428:x1876700083286528:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632374:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3428:x1876700083286528:12345-0@lo:400: Request processed in 31us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632380:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789760778.632392:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760778.632398:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083286400:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632436:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083286400:12345-0@lo:400: Request processed in 39us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632441:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789760778.632458:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285632 00000100:00100000:3.0:1789760778.632462:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285632 00000100:00100000:3.0:1789760778.632480:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286144 00000100:00100000:3.0:1789760778.632482:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286144 00000100:00100000:3.0:1789760778.632492:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286272 00000100:00100000:3.0:1789760778.632495:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286272 00000100:00100000:3.0:1789760778.632505:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083285888 00000100:00100000:3.0:1789760778.632507:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083285888 00000100:00100000:3.0:1789760778.632518:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760778.632524:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083285632:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632553:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083285632:12345-0@lo:400: Request processed in 29us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632559:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760778.632570:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760778.632576:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083286144:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632601:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083286144:12345-0@lo:400: Request processed in 27us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632606:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760778.632616:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760778.632621:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3430:x1876700083286272:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632646:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3430:x1876700083286272:12345-0@lo:400: Request processed in 25us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632652:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760778.632662:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789760778.632667:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083285888:12345-0@lo:400: 00000100:00100000:3.0:1789760778.632728:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083285888:12345-0@lo:400: Request processed in 60us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760778.632734:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789760778.632784:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760778.632788:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760778.632791:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760778.632829:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bd505880 x1876700083285888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.632845:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083285888:0@lo:400: 00010000:00080000:3.0:1789760778.632858:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330ba16e300 x1876700083286400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.632865:0:3430:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789760778.632880:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083286400:0@lo:400: 00000100:00100000:3.0:1789760778.632891:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083285760:0@lo:400: 00010000:00080000:3.0:1789760778.632900:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330ba16f100 x1876700083286272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.632907:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3430:1876700083286272:0@lo:400: 00010000:00080000:3.0:1789760778.632937:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330bd504000 x1876700083285632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.632944:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083285632:0@lo:400: 00010000:00080000:3.0:1789760778.632953:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330ba16ce00 x1876700083286144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.632961:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083286144:0@lo:400: 00000100:00100000:3.0:1789760778.632979:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083285504:0@lo:400: 00000100:00100000:3.0:1789760778.632989:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083286016:0@lo:400: 00010000:00080000:3.0:1789760778.632998:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330ba16ed80 x1876700083286528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760778.633006:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083286528:0@lo:400: 00000100:00100000:0.0:1789760778.634149:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083286656:0@lo:13: 00000100:00100000:0.0:1789760778.634235:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760778.634436:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083286784:0@lo:13: 00000100:00100000:0.0:1789760778.634476:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760778.634487:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286656 00000100:00100000:1.0:1789760778.634495:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286656 00000100:00100000:1.0:1789760778.634530:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286784 00000100:00100000:1.0:1789760778.634534:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286784 00000100:00100000:1.0:1789760778.634640:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760778.634652:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083286656:12345-0@lo:13: 00002000:00000024:1.0:1789760778.634696:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760778.634742:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083286656:12345-0@lo:13: Request processed in 92us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760778.634748:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760778.634763:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789760778.634769:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3430:x1876700083286784:12345-0@lo:13: 00002000:00000024:1.0:1789760778.634778:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760778.634886:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3430:x1876700083286784:12345-0@lo:13: Request processed in 116us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760778.634892:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789760778.634925:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3ce00 x1876700083286656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760778.634944:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083286656:0@lo:13: 00010000:00080000:0.0:1789760778.634976:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b3d3c700 x1876700083286784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760778.634989:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083286784:0@lo:13: 00000001:00080000:2.0:1789760778.700119:0:8103:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789760779.145890:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083286912:0@lo:41: 00000100:00100000:3.0:1789760779.145957:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760779.146026:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083286912 00000100:00100000:3.0:1789760779.146032:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083286912 00000100:00100000:3.0:1789760779.146068:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760779.146076:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083286912:12345-0@lo:41: 00000004:00000024:3.0:1789760779.146112:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760779.146153:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083286912:12345-0@lo:41: Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760779.146158:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760779.146401:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083286912:0@lo:41: 00010000:00010000:3.0:1789760779.590318:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760780.619724:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760781.638400:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760782.214336:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083287040:0@lo:41: 00000100:00100000:1.0:1789760782.214419:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760782.214960:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287040 00000100:00100000:0.0:1789760782.214976:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287040 00000100:00100000:0.0:1789760782.215041:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789760782.215053:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083287040:12345-0@lo:41: 00000004:00000024:0.0:1789760782.215100:0:6434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760782.215352:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083287040:12345-0@lo:41: Request processed in 300us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760782.215360:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760782.215937:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083287040:0@lo:41: 00010000:00010000:3.0:1789760782.668647:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789760783.523391:0:9026:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789760783.523395:0:9026:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789760783.523528:0:9026:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9330b47d7000 00000020:01000004:2.0:1789760783.523546:0:9026:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789760783.523604:0:9026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789760783.523623:0:9026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9330bf1d0000) 00000020:00000080:2.0:1789760783.523639:0:9026:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789760783.537496:0:9026:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789760783.537809:0:9026:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789760783.554556:0:9026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789760783.558815:0:9026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789760783.558844:0:9026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789760783.558894:0:9026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789760783.558915:0:9026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789760783.559238:0:9026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789760783.559252:0:9026:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789760783.559261:0:9026:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x838c7b3c022b7555 00000020:01000004:2.0:1789760783.559269:0:9026:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789760783.559291:0:9026:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.153@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789760783.559295:0:9026:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789760783.559300:0:9026:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789760783.559321:0:9026:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789760783.559326:0:9026:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789760783.574750:0:9026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789760783.574786:0:9026:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.153@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789760783.574791:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789760783.574792:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789760783.574794:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760783.574796:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760783.574797:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760783.574798:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760783.574800:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760783.574802:0:9026:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760783.574804:0:9026:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760783.574809:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760783.574810:0:9026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760783.574813:0:9026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789760783.574816:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789760783.574817:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789760783.574818:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789760783.574819:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789760783.574820:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789760783.574821:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789760783.574822:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789760783.574823:0:9026:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789760783.574824:0:9026:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789760783.574825:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789760783.574826:0:9026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789760783.574848:0:9026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789760783.574865:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083287168:0@lo:253: 00000100:00100000:2.0:1789760783.574926:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760783.575019:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.575086:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287168 00000100:00100000:1.0:1789760783.575093:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287168 00000100:00100000:1.0:1789760783.575144:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789760783.575154:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+21:9026:x1876700083287168:12345-0@lo:253: 20000000:01000000:1.0:1789760783.575315:0:6425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789760783.575319:0:6425:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789760783.575323:0:6425:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789760783.575327:0:6425:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789760783.576526:0:6425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789760783.576888:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789760783.576902:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789760783.576943:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789760783.576951:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789760783.576980:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789760783.577028:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789760783.577447:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789760783.577465:0:6425:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:0.0:1789760783.577468:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:0.0:1789760783.577503:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789760783.577511:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789760783.577558:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789760783.577567:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:0.0:1789760783.577603:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789760783.577612:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789760783.577643:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789760783.577762:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789760783.578155:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789760783.578170:0:6425:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:0.0:1789760783.578171:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:0.0:1789760783.578299:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789760783.578308:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789760783.578368:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789760783.578377:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:0.0:1789760783.578411:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789760783.578421:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789760783.578469:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789760783.578535:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789760783.579395:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789760783.579414:0:6425:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.153@tcp 20000000:01000000:0.0:1789760783.579416:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.153@tcp (null) (null) (null) 00000040:00080000:0.0:1789760783.579453:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789760783.579461:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789760783.579493:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789760783.579500:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.153@tcp (null) (null) 00000040:00080000:0.0:1789760783.579532:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789760783.579542:0:6425:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789760783.579610:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789760783.579665:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789760783.579748:0:6425:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789760783.579751:0:6425:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789760783.579755:0:6425:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789760783.579766:0:6425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789760783.579768:0:6425:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789760783.579804:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789760783.579806:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760783.580473:0:9028:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760783.580526:0:9028:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760783.580579:0:9028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789760783.580900:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789760783.580955:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789760783.580991:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1789760783.581002:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789760783.581004:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760783.581514:0:9029:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760783.581560:0:9029:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760783.581617:0:9029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789760783.581907:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789760783.581944:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789760783.581997:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1789760783.582017:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789760783.582019:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760783.582844:0:9030:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760783.582923:0:9030:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760783.582960:0:9030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789760783.583327:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789760783.583369:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789760783.583439:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1789760783.583453:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789760783.583456:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789760783.583863:0:9031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789760783.584055:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789760783.584092:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789760783.584143:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789760783.584155:0:6425:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789760783.584157:0:6425:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789760783.584826:0:9032:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789760783.584877:0:9032:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789760783.584935:0:9032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789760783.585161:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789760783.585319:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789760783.585373:0:6425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789760783.585389:0:6425:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789760783.585391:0:6425:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789760783.585399:0:6425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789760783.585418:0:6425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585436:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b744b expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585444:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 21 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585451:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585457:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585477:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 21 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585485:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 21 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585492:0:6425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585500:0:6425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585538:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585551:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.585564:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287296:0@lo:104: 00000100:00100000:0.0:1789760783.585627:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760783.585724:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 21 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585733:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 21 pid: 6424 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.585742:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287424:0@lo:104: 00000100:00100000:0.0:1789760783.585763:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760783.585892:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 21 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.585908:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 21 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.585917:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287552:0@lo:104: 00000100:00100000:0.0:1789760783.585940:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760783.586006:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287296 00000100:00100000:2.0:1789760783.586013:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287296 00000100:00100000:2.0:1789760783.586071:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287424 00000100:00100000:2.0:1789760783.586074:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287424 00000100:00100000:2.0:1789760783.586089:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760783.586096:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+4:6425:x1876700083287296:12345-0@lo:104: 00010000:00010000:2.0:1789760783.586107:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.586157:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760783.586162:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+4:6425:x1876700083287296:12345-0@lo:104: Request processed in 67us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.586169:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760783.586210:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760783.586217:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083287424:12345-0@lo:104: 00010000:00010000:2.0:1789760783.586234:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.586263:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789760783.586268:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083287424:12345-0@lo:104: Request processed in 52us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.586273:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1789760783.586377:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760783.586383:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586390:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933081650800 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760783.586394:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586402:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760783.586408:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760783.586413:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760783.586444:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586449:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760783.586467:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586474:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933081650800/0x838c7b3c022b7540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7547 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586485:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789760783.586494:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586500:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7458400 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760783.586502:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586508:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789760783.586514:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760783.586518:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760783.586531:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586536:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760783.586547:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586553:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7458400/0x838c7b3c022b7516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b751d expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.586561:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760783.586563:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760783.586564:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789760783.586748:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287552 00000100:00100000:2.0:1789760783.586752:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287552 00000100:00100000:2.0:1789760783.586777:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760783.586783:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083287552:12345-0@lo:104: 00010000:00010000:2.0:1789760783.586791:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.586824:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789760783.586829:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083287552:12345-0@lo:104: Request processed in 47us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.586836:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789760783.586880:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760783.586884:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.586891:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933081651200 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:0.0:1789760783.586894:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.586901:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760783.586908:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760783.586913:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760783.586937:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.586944:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760783.586950:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.586956:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933081651200/0x838c7b3c022b74fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7501 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.586975:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760783.586977:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760783.586979:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760783.586991:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083287680:0@lo:103: 00000100:00100000:0.0:1789760783.587020:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.587060:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287680 00000100:00100000:0.0:1789760783.587065:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287680 00010000:00010000:0.0:1789760783.587082:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.587102:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760783.587109:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+22:3429:x1876700083287680:12345-0@lo:103: 00010000:00010000:0.0:1789760783.587119:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.587124:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587135:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587151:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.587177:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+22:3429:x1876700083287680:12345-0@lo:103: Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.587208:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789760783.587242:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083287680:0@lo:103: 00010000:00010000:0.0:1789760783.587270:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587290:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 21 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.587299:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288064:0@lo:104: 00000100:00100000:0.0:1789760783.587321:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.587341:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288064 00000100:00100000:0.0:1789760783.587344:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288064 00000100:00100000:0.0:1789760783.587361:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760783.587367:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288064:12345-0@lo:104: 00010000:00010000:0.0:1789760783.587374:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587406:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760783.587411:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288064:12345-0@lo:104: Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.587416:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789760783.587429:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789760783.587433:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587438:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933080030e00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:0.0:1789760783.587441:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587447:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789760783.587453:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760783.587464:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789760783.587478:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587484:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789760783.587497:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587503:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933080030e00/0x838c7b3c022b74d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74d7 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587512:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760783.587514:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760783.587516:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760783.587521:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760783.587528:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083288192:0@lo:103: 00000100:00100000:0.0:1789760783.587552:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789760783.587585:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587592:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 21 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.587600:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288320:0@lo:104: 00000100:00100000:0.0:1789760783.587618:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.587635:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288320 00000100:00100000:0.0:1789760783.587638:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288320 00000100:00100000:0.0:1789760783.587667:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789760783.587673:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288320:12345-0@lo:104: 00010000:00010000:0.0:1789760783.587804:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587871:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789760783.587877:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288320:12345-0@lo:104: Request processed in 204us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.587883:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1789760783.587910:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 21 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.587918:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 21 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.587926:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288448:0@lo:104: 00000100:00100000:0.0:1789760783.587951:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.587975:0:8101:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789760783.587982:0:8101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288448 00000100:00100000:0.0:1789760783.587985:0:8101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288448 00000100:00100000:0.0:1789760783.588001:0:8101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760783.588006:0:8101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b4270450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288448:12345-0@lo:104: 00010000:00010000:0.0:1789760783.588013:0:8101:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.588096:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288192 00000100:00100000:1.0:1789760783.588101:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288192 00010000:00010000:1.0:1789760783.588117:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.588137:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760783.588142:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+22:3429:x1876700083288192:12345-0@lo:103: 00010000:00010000:1.0:1789760783.588149:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760783.588153:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.588160:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.588173:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760783.588216:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+22:3429:x1876700083288192:12345-0@lo:103: Request processed in 74us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.588222:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760783.588251:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083288192:0@lo:103: 00010000:00010000:1.0:1789760783.588295:0:6425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 21 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.588303:0:6425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 21 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.588312:0:6425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288576:0@lo:104: 00000100:00100000:1.0:1789760783.588334:0:6425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.588352:0:6413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288576 00000100:00100000:1.0:1789760783.588355:0:6413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288576 00000100:00100000:1.0:1789760783.588370:0:6413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760783.588383:0:6413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+4:6425:x1876700083288576:12345-0@lo:104: 00010000:00010000:1.0:1789760783.588391:0:6413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.588498:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083287808:0@lo:103: 00000100:00100000:3.0:1789760783.588526:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760783.588550:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760783.588555:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083287936:0@lo:103: 00000100:00100000:3.0:1789760783.588587:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789760783.588691:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789760783.588697:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588704:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7458000 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760783.588708:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588715:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760783.588733:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760783.588739:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760783.588758:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588764:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760783.588774:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588781:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b74b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74bb expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588792:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789760783.588795:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588800:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7459c00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760783.588803:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588809:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760783.588815:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760783.588820:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760783.588837:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588843:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760783.588854:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588861:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7459c00/0x838c7b3c022b7475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b747c expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588882:0:6419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789760783.588885:0:6419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588891:0:6419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7458200 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:2.0:1789760783.588894:0:6419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588900:0:6419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789760783.588906:0:6419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760783.588911:0:6419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789760783.588923:0:6419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588928:0:6419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789760783.588933:0:6419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588948:0:6419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7458200/0x838c7b3c022b744b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b7452 expref: -99 pid: 8072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.588961:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760783.588962:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789760783.588964:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789760783.589082:0:8101:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789760783.589089:0:8101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b4270450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:751d7670-4ea9-4485-a191-8db5c056760e+4:6425:x1876700083288448:12345-0@lo:104: Request processed in 1082us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.589096:0:8101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760783.589132:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287808 00000100:00100000:0.0:1789760783.589141:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287808 00010000:00010000:0.0:1789760783.589155:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 22 pid: 6424 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.589171:0:6417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083287936 00000100:00100000:0.0:1789760783.589173:0:6417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083287936 00010000:00010000:0.0:1789760783.589201:0:6417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 23 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.589217:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760783.589224:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+23:3430:x1876700083287808:12345-0@lo:103: 00010000:00010000:0.0:1789760783.589231:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.589235:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 23 pid: 6424 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.589243:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 23 pid: 6424 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.589254:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.589278:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+23:3430:x1876700083287808:12345-0@lo:103: Request processed in 54us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.589285:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760783.589296:0:6417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789760783.589302:0:6417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+22:3430:x1876700083287936:12345-0@lo:103: 00010000:00010000:0.0:1789760783.589308:0:6417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.589312:0:6417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 22 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.589320:0:6417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 22 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.589341:0:6417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.589365:0:6417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:751d7670-4ea9-4485-a191-8db5c056760e+22:3430:x1876700083287936:12345-0@lo:103: Request processed in 64us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.589371:0:6417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789760783.589450:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.589495:0:6413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789760783.589501:0:6413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:751d7670-4ea9-4485-a191-8db5c056760e+3:6425:x1876700083288576:12345-0@lo:104: Request processed in 1118us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.589507:0:6413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760783.589525:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760783.589534:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083288704:0@lo:103: 00000100:00100000:1.0:1789760783.589561:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.589594:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288704 00000100:00100000:1.0:1789760783.589597:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288704 00010000:00010000:1.0:1789760783.589611:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589630:0:6416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760783.589635:0:6416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+22:3428:x1876700083288704:12345-0@lo:103: 00010000:00010000:1.0:1789760783.589642:0:6416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760783.589656:0:6416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.589666:0:6416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 22 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.589748:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.589770:0:6416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760783.589807:0:6416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:751d7670-4ea9-4485-a191-8db5c056760e+22:3428:x1876700083288704:12345-0@lo:103: Request processed in 171us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.589813:0:6416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760783.589846:0:6425:0:(client.c:2715:ptlrpc_set_wait()) set ffff933083953cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789760783.589864:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650c00/0x838c7b3c022b7547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7540 expref: 21 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589875:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287296:0@lo:104: 00010000:00010000:1.0:1789760783.589885:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7458600/0x838c7b3c022b751d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7516 expref: 20 pid: 6424 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589894:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287424:0@lo:104: 00010000:00010000:1.0:1789760783.589903:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459600/0x838c7b3c022b7501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b74fa expref: 19 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589911:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083287552:0@lo:104: 00010000:00010000:1.0:1789760783.589920:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650400/0x838c7b3c022b74d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b74d0 expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589928:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288064:0@lo:104: 00010000:00010000:1.0:1789760783.589935:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650000/0x838c7b3c022b74bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b74b4 expref: 17 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.589943:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288320:0@lo:104: 00000100:00100000:1.0:1789760783.589951:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288448:0@lo:104: 00000100:00100000:1.0:1789760783.589959:0:6425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6425:1876700083288576:0@lo:104: 00010000:00010000:1.0:1789760783.589982:0:6425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.590041:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:751d7670-4ea9-4485-a191-8db5c056760e:3428:1876700083288704:0@lo:103: 00010000:00010000:3.0:1789760783.590119:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760783.590132:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083288832:0@lo:103: 00000100:00100000:3.0:1789760783.590158:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.590280:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083288960:0@lo:103: 00000100:00100000:0.0:1789760783.590328:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.590499:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288832 00000100:00100000:1.0:1789760783.590504:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288832 00010000:00010000:1.0:1789760783.590526:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 17 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.590581:0:6416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083288960 00000100:00100000:1.0:1789760783.590585:0:6416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083288960 00010000:00010000:1.0:1789760783.590596:0:6416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.590710:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083287936:0@lo:103: 00000100:00100000:3.0:1789760783.590718:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083287808:0@lo:103: 00000100:00100000:0.0:1789760783.590861:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760783.590870:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+18:3430:x1876700083288832:12345-0@lo:103: 00010000:00010000:0.0:1789760783.590880:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.590885:0:6415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 18 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.590895:0:6415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 18 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.590908:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081650e00/0x838c7b3c022b747c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7475 expref: 18 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.590918:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.590990:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+17:3430:x1876700083288832:12345-0@lo:103: Request processed in 121us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.590996:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789760783.591012:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789760783.591019:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+16:3431:x1876700083288960:12345-0@lo:103: 00010000:00010000:0.0:1789760783.591026:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.591030:0:6415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 16 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591050:0:6415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 16 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591060:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b744b expref: 16 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591073:0:6415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591081:0:6415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591094:0:6415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591102:0:6415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591108:0:6415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591114:0:6415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591120:0:6415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7459800 already unused, calling callback (ffffffffc1470350) 00010000:00010000:0.0:1789760783.591124:0:6415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591131:0:6415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591155:0:6415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.591163:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.591208:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+15:3431:x1876700083288960:12345-0@lo:103: Request processed in 189us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.591215:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789760783.591240:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083288960:0@lo:103: 00010000:00010000:1.0:1789760783.591339:0:6425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.591347:0:6425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.591354:0:6425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7459800/0x838c7b3c022b755c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760783.591367:0:6425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789760783.591765:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:751d7670-4ea9-4485-a191-8db5c056760e:3430:1876700083288832:0@lo:103: 00000100:00100000:2.0:1789760783.625958:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+14:9026:x1876700083287168:12345-0@lo:253: Request processed in 50797us (51024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.625983:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789760783.626216:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083287168:0@lo:253: 10000000:01000000:0.0:1789760783.626232:0:9026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789760783.626236:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789760783.626237:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789760783.626239:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789760783.626240:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789760783.626241:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789760783.626242:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789760783.626244:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789760783.626246:0:9026:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789760783.626247:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789760783.626248:0:9026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789760783.626267:0:9026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9330b47d7000 from lustre-OST0001 10000000:01000000:0.0:1789760783.626292:0:9026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789760783.626296:0:9026:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789760783.626304:0:9026:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff93309ea30000 local copy 10000000:01000000:0.0:1789760783.626309:0:9026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789760783.626345:0:9026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.626357:0:9026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.626386:0:9026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.626405:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289088:0@lo:101: 00000100:00100000:0.0:1789760783.626439:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.626520:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff933099665c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760783.626560:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289088 00000100:00100000:3.0:1789760783.626566:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289088 00000100:00100000:3.0:1789760783.626642:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789760783.626662:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+14:9026:x1876700083289088:12345-0@lo:101: 00010000:00010000:3.0:1789760783.626674:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760783.626695:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080031e00/0x838c7b3c022b756a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7563 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.626719:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080031e00/0x838c7b3c022b756a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7563 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.626729:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080031e00/0x838c7b3c022b756a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7563 expref: 15 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.626738:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080031e00, rc 0) 00000100:00100000:3.0:1789760783.626780:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289088:12345-0@lo:101: Request processed in 120us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.626785:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789760783.626848:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289088:0@lo:101: 00010000:00010000:0.0:1789760783.626859:0:9026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.626867:0:9026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.626960:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289216:0@lo:501: 00000100:00100000:0.0:1789760783.626997:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.627224:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff933099665c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.627345:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289216 00000100:00100000:1.0:1789760783.627350:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289216 00000100:00100000:1.0:1789760783.627373:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789760783.627381:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289216:12345-0@lo:501: 00000100:00100000:1.0:1789760783.627574:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289216:12345-0@lo:501: Request processed in 193us (575us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760783.627581:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789760783.627661:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289216:0@lo:501: 10000000:01000000:0.0:1789760783.627683:0:9026:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789760783.627709:0:9026:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789760783.627714:0:9026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.627723:0:9026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.627731:0:9026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.627761:0:9026:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789760783.627782:0:9026:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9330b47d7000 10000000:01000000:0.0:1789760783.627787:0:9026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789760783.627792:0:9026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789760783.627795:0:9026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789760783.627799:0:9026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789760783.627801:0:9026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789760783.627817:0:9026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.627824:0:9026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.627833:0:9026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.627844:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289344:0@lo:101: 00000100:00100000:0.0:1789760783.627870:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.627881:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330996653c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789760783.627986:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760783.627993:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628000:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7459000 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:1.0:1789760783.628003:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628017:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760783.628024:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760783.628030:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789760783.628047:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628053:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760783.628080:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628087:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7459000/0x838c7b3c022b7563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x838c7b3c022b756a expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628099:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.628101:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.628103:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760783.628110:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789760783.628119:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083289472:0@lo:103: 00000100:00100000:1.0:1789760783.628146:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.628168:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289344 00000100:00100000:1.0:1789760783.628171:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289344 00000100:00100000:1.0:1789760783.628215:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789760783.628222:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289344:12345-0@lo:101: 00010000:00010000:1.0:1789760783.628230:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760783.628239:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650000/0x838c7b3c022b7578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7571 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628263:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650000/0x838c7b3c022b7578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7571 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628272:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650000/0x838c7b3c022b7578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7571 expref: 16 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.628279:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650000, rc 0) 00000100:00100000:1.0:1789760783.628307:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083289344:12345-0@lo:101: Request processed in 86us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.628313:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789760783.628436:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289472 00000100:00100000:0.0:1789760783.628441:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289472 00000100:00100000:0.0:1789760783.628479:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760783.628486:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+16:3429:x1876700083289472:12345-0@lo:103: 00010000:00010000:0.0:1789760783.628495:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789760783.628505:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933080031e00/0x838c7b3c022b756a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x838c7b3c022b7563 expref: 16 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.628514:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789760783.628551:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+15:3429:x1876700083289472:12345-0@lo:103: Request processed in 65us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.628558:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760783.628583:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083289472:0@lo:103: 00000100:00100000:0.0:1789760783.628608:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289344:0@lo:101: 00010000:00010000:0.0:1789760783.628618:0:9026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7578 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760783.628625:0:9026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7578 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.628786:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289600:0@lo:501: 00000100:00100000:0.0:1789760783.628810:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.628837:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330996653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.628874:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289600 00000100:00100000:1.0:1789760783.628878:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289600 00000100:00100000:1.0:1789760783.628894:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789760783.628900:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289600:12345-0@lo:501: 00000100:00100000:1.0:1789760783.629077:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289600:12345-0@lo:501: Request processed in 176us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.629084:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789760783.629216:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289600:0@lo:501: 00000100:00100000:0.0:1789760783.629241:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289728:0@lo:503: 00000100:00100000:0.0:1789760783.629278:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.629293:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330996653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.629379:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289728 00000100:00100000:1.0:1789760783.629383:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289728 00000100:00100000:1.0:1789760783.629402:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789760783.629407:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289728:12345-0@lo:503: 00000100:00100000:1.0:1789760783.629545:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289728:12345-0@lo:503: Request processed in 136us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.629551:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789760783.629614:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289728:0@lo:503: 00000040:00080000:0.0:1789760783.629906:0:9026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760783.629980:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289856:0@lo:502: 00000100:00100000:0.0:1789760783.630014:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.630035:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330996653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.630212:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289856 00000100:00100000:1.0:1789760783.630217:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289856 00000100:00100000:1.0:1789760783.630236:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789760783.630250:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289856:12345-0@lo:502: 00000100:00100000:1.0:1789760783.630386:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289856:12345-0@lo:502: Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.630393:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789760783.630477:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289856:0@lo:502: 00000040:00080000:0.0:1789760783.630773:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789760783.630831:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789760783.630868:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789760783.630913:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789760783.630948:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789760783.631062:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789760783.631091:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289984:0@lo:502: 00000100:00100000:0.0:1789760783.631128:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.631208:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330996653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789760783.631269:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083289984 00000100:00100000:3.0:1789760783.631274:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083289984 00000100:00100000:2.0:1789760783.631346:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789760783.631356:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289984:12345-0@lo:502: 00000100:00100000:2.0:1789760783.631511:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083289984:12345-0@lo:502: Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.631518:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789760783.631584:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083289984:0@lo:502: 00000040:00080000:0.0:1789760783.631695:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789760783.631704:0:9026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789760783.632149:0:9035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789760783.632157:0:9035:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789760783.632163:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760783.632165:0:9035:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789760783.632170:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789760783.632212:0:9035:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9330b5994d28) 00000020:00000080:0.0:1789760783.632235:0:9035:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789760783.632242:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789760783.632308:0:9035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b47d7000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789760783.632316:0:9035:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789760783.632323:0:9035:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x838c7b3c022b7586 00010000:00010000:0.0:1789760783.638489:0:9035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1789760783.638908:0:9035:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789760783.642210:0:9035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789760783.642501:0:9035:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789760783.647177:0:9035:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789760783.647830:0:9035:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789760783.649329:0:9035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789760783.649341:0:9035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760783.649352:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760783.649355:0:9035:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789760783.649359:0:9035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789760783.649362:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760783.649363:0:9035:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789760783.649366:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789760783.649368:0:9035:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789760783.649414:0:9035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789760783.649418:0:9035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789760783.649420:0:9035:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789760783.649423:0:9035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789760783.654790:0:9026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789760783.654831:0:9026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789760783.655873:0:9026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7578 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.655887:0:9026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7459a00/0x838c7b3c022b7571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7578 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760783.655910:0:9026:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9330b47d7000 from 1 10000000:01000000:2.0:1789760783.655913:0:9026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789760783.655951:0:9026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.655959:0:9026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.655981:0:9026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760783.656003:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290112:0@lo:101: 00000100:00100000:2.0:1789760783.656067:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760783.656111:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.656190:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290112 00000100:00100000:1.0:1789760783.656198:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290112 00000100:00100000:1.0:1789760783.656246:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760783.656256:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083290112:12345-0@lo:101: 00010000:00010000:1.0:1789760783.656269:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760783.656282:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650400/0x838c7b3c022b7594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b758d expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.656306:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650400/0x838c7b3c022b7594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b758d expref: 16 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.656316:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650400/0x838c7b3c022b7594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b758d expref: 16 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.656324:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650400, rc 0) 00000100:00100000:1.0:1789760783.656365:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290112:12345-0@lo:101: Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.656372:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789760783.656419:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290112:0@lo:101: 00010000:00010000:1.0:1789760783.656434:0:9026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7594 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.656443:0:9026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7594 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.656550:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290240:0@lo:501: 00000100:00100000:1.0:1789760783.656576:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.656591:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93309e9f5180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.656606:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290240 00000100:00100000:1.0:1789760783.656610:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290240 00000100:00100000:1.0:1789760783.656629:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789760783.656635:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290240:12345-0@lo:501: 00000100:00100000:1.0:1789760783.656857:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290240:12345-0@lo:501: Request processed in 220us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.656864:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789760783.656894:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290240:0@lo:501: 00000100:00100000:1.0:1789760783.656920:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290368:0@lo:503: 00000100:00100000:1.0:1789760783.656957:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.656971:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5880c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.656984:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290368 00000100:00100000:1.0:1789760783.656987:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290368 00000100:00100000:1.0:1789760783.657008:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789760783.657014:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290368:12345-0@lo:503: 00000100:00100000:1.0:1789760783.657301:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290368:12345-0@lo:503: Request processed in 286us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.657308:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789760783.657348:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290368:0@lo:503: 00000040:00080000:1.0:1789760783.657633:0:9026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789760783.657708:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290496:0@lo:502: 00000100:00100000:1.0:1789760783.657752:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.657769:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.657783:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290496 00000100:00100000:1.0:1789760783.657787:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290496 00000100:00100000:1.0:1789760783.657811:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760783.657818:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290496:12345-0@lo:502: 00000100:00100000:1.0:1789760783.657956:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290496:12345-0@lo:502: Request processed in 138us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.657963:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789760783.658006:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290496:0@lo:502: 00000040:00080000:1.0:1789760783.658240:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789760783.658287:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789760783.658309:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290624:0@lo:502: 00000100:00100000:1.0:1789760783.658342:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.658356:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.658369:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290624 00000100:00100000:1.0:1789760783.658373:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290624 00000100:00100000:1.0:1789760783.658393:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760783.658399:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290624:12345-0@lo:502: 00000100:00100000:1.0:1789760783.658511:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290624:12345-0@lo:502: Request processed in 112us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.658518:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789760783.658556:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290624:0@lo:502: 00000040:00080000:1.0:1789760783.658628:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789760783.658638:0:9026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789760783.660078:0:9039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789760783.660088:0:9039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760783.660090:0:9039:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789760783.660097:0:9039:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9330b47d7000 00000020:00000080:2.0:1789760783.660099:0:9039:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789760783.660121:0:9039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760783.660125:0:9039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760783.660127:0:9039:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789760783.660129:0:9039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789760783.660319:0:9026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789760783.660340:0:9026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789760783.660461:0:9026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7594 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.660474:0:9026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330814f9400/0x838c7b3c022b758d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7594 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760783.660520:0:9026:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789760783.660523:0:9026:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9330b47d7000 10000000:01000000:1.0:1789760783.660527:0:9026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9330b47d7000 10000000:01000000:1.0:1789760783.660530:0:9026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789760783.660535:0:9026:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9330b47d7000 from 1 10000000:01000000:1.0:1789760783.660538:0:9026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789760783.660567:0:9026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.660576:0:9026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.660586:0:9026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.660604:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290752:0@lo:101: 00000100:00100000:1.0:1789760783.660664:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.660768:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760783.660821:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290752 00000100:00100000:2.0:1789760783.660829:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290752 00000100:00100000:2.0:1789760783.660871:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789760783.660879:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9026:x1876700083290752:12345-0@lo:101: 00010000:00010000:2.0:1789760783.660890:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760783.660902:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f9800/0x838c7b3c022b75a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b759b expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.660931:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f9800/0x838c7b3c022b75a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b759b expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.660943:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f9800/0x838c7b3c022b75a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b759b expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760783.660951:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f9800, rc 0) 00000100:00100000:2.0:1789760783.661148:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083290752:12345-0@lo:101: Request processed in 268us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.661154:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789760783.661350:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290752:0@lo:101: 00010000:00010000:1.0:1789760783.661364:0:9026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75a2 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.661372:0:9026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b75a2 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.661468:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290880:0@lo:501: 00000100:00100000:1.0:1789760783.661495:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.661524:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760783.661564:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083290880 00000100:00100000:2.0:1789760783.661568:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083290880 00000100:00100000:2.0:1789760783.661593:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789760783.661599:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083290880:12345-0@lo:501: 00000100:00100000:2.0:1789760783.661825:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083290880:12345-0@lo:501: Request processed in 225us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.661832:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789760783.661973:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083290880:0@lo:501: 00000100:00100000:0.0:1789760783.662003:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291008:0@lo:503: 00000100:00100000:0.0:1789760783.662040:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.662060:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff933086432540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760783.662155:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291008 00000100:00100000:2.0:1789760783.662159:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291008 00000100:00100000:2.0:1789760783.662206:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789760783.662213:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291008:12345-0@lo:503: 00000100:00100000:2.0:1789760783.662341:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291008:12345-0@lo:503: Request processed in 128us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.662347:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789760783.662428:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291008:0@lo:503: 00000040:00080000:0.0:1789760783.662685:0:9026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789760783.662742:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291136:0@lo:502: 00000100:00100000:0.0:1789760783.662774:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.662804:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff933086432540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760783.662904:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291136 00000100:00100000:2.0:1789760783.662909:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291136 00000100:00100000:2.0:1789760783.662939:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789760783.662953:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291136:12345-0@lo:502: 00000100:00100000:2.0:1789760783.663124:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291136:12345-0@lo:502: Request processed in 172us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.663131:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789760783.663372:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291136:0@lo:502: 00000040:00080000:0.0:1789760783.663590:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789760783.663631:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789760783.663672:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789760783.663826:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789760783.663863:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789760783.663906:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789760783.663943:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789760783.664047:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789760783.664106:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789760783.664145:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789760783.664281:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789760783.664341:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789760783.664391:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789760783.664427:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789760783.664477:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789760783.664513:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789760783.664545:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789760783.664590:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789760783.664625:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789760783.664671:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789760783.664871:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789760783.664909:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789760783.664945:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789760783.665071:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789760783.665110:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789760783.665141:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789760783.665387:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789760783.665427:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789760783.665472:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789760783.665513:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789760783.665541:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789760783.665567:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789760783.665593:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789760783.665630:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789760783.665675:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789760783.665800:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789760783.665839:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789760783.665875:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789760783.665922:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789760783.665959:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789760783.666067:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789760783.666117:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789760783.666328:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789760783.666373:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789760783.666428:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789760783.666479:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789760783.666526:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291264:0@lo:502: 00000100:00100000:0.0:1789760783.666600:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.666706:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff933086432540 going to sleep for 11 seconds 00000100:00100000:2.0:1789760783.666806:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291264 00000100:00100000:2.0:1789760783.666813:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291264 00000100:00100000:2.0:1789760783.666909:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789760783.666920:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291264:12345-0@lo:502: 00000100:00100000:2.0:1789760783.667173:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083291264:12345-0@lo:502: Request processed in 254us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.667210:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789760783.667308:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083291264:0@lo:502: 00000040:00080000:0.0:1789760783.667384:0:9026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789760783.667394:0:9026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1789760783.667982:0:9040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789760783.668006:0:9040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff932f83f50000) 00000020:00000080:3.0:1789760783.668034:0:9040:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1789760783.668103:0:9040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b47d7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789760783.668107:0:9040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9330b47d7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789760783.668110:0:9040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9330b47d7000 3 00010000:00080000:3.0:1789760783.668135:0:9040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9330b5ebd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.153@tcp at head 00010000:00010000:0.0:1789760783.670829:0:9040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789760783.671841:0:9040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789760783.671882:0:9040:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789760783.671896:0:9040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x838c7b3c022b75b0 00000100:00080000:0.0:1789760783.671906:0:9040:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789760783.671912:0:9040:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9330b5ebd000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:0.0:1789760783.671943:0:9040:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330b43b8000 x1876700083291392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789760783.672044:0:9040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789760783.672152:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083291648:0@lo:400: 00000100:00100000:3.0:1789760783.672264:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.672383:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3427:1876700083291392:0@lo:38: 00000100:00100000:1.0:1789760783.672436:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.672483:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291392 00000100:00100000:1.0:1789760783.672490:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291392 00000100:00100000:1.0:1789760783.672518:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760783.672526:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3427:x1876700083291392:12345-0@lo:38: 00010000:00080000:1.0:1789760783.672548:0:6431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1789760783.672576:0:6431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x838c7b3c022b75b7 00000004:00100000:1.0:1789760783.672589:0:6431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789760783.672617:0:6431:0:(import.c:65:import_set_state_nolock()) ffff9330b5e0b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760783.672686:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3427:x1876700083291392:12345-0@lo:38: Request processed in 152us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.672693:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789760783.672732:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43b8000 x1876700083291392/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760783.672742:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789760783.672749:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789760783.672755:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789760783.672759:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789760783.672762:0:3427:0:(import.c:65:import_set_state_nolock()) ffff9330b5ebd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789760783.672767:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3427:1876700083291392:0@lo:38: 00000100:00100000:3.0:1789760783.672901:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760783.672909:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083291776:0@lo:400: 00000100:00100000:3.0:1789760783.672935:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760783.672980:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291648 00000100:00100000:3.0:1789760783.672984:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291648 00000100:00100000:3.0:1789760783.673012:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789760783.673019:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083291648:12345-0@lo:400: 00000100:00100000:3.0:1789760783.673056:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083291648:12345-0@lo:400: Request processed in 38us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.673062:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789760783.673091:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083291648:0@lo:400: 00000100:00100000:1.0:1789760783.673210:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291776 00000100:00100000:1.0:1789760783.673215:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291776 00000100:00100000:1.0:1789760783.673244:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789760783.673251:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083291776:12345-0@lo:400: 00000100:00100000:1.0:1789760783.673287:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083291776:12345-0@lo:400: Request processed in 37us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.673293:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789760783.673316:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43b8380 x1876700083291776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760783.673326:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083291776:0@lo:400: 00000100:00100000:1.0:1789760783.674844:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083291520:0@lo:400: 00000100:00100000:1.0:1789760783.674896:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.675209:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789760783.675297:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291520 00000100:00100000:2.0:1789760783.675379:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291520 00000100:00100000:2.0:1789760783.675416:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789760783.675425:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083291520:12345-0@lo:400: 00000100:00100000:1.0:1789760783.676314:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3429:1876700083292032:0@lo:400: 00000100:00100000:1.0:1789760783.676352:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.676417:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083291904:0@lo:400: 00000100:00100000:1.0:1789760783.676442:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.676559:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083292416:0@lo:400: 00000100:00100000:0.0:1789760783.676588:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.676619:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083292288:0@lo:400: 00000100:00100000:0.0:1789760783.676643:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.676673:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789760783.676690:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3431:1876700083292160:0@lo:400: 00000100:00100000:0.0:1789760783.676716:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760783.676745:0:6431:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789760783.676846:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083291904 00000100:00100000:0.0:1789760783.676853:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083291904 00000100:00100000:0.0:1789760783.676889:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760783.676897:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083291904:12345-0@lo:400: 00000100:00100000:0.0:1789760783.676938:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083291904:12345-0@lo:400: Request processed in 42us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.676945:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789760783.677046:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292416 00000100:00100000:0.0:1789760783.677051:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292416 00000100:00100000:0.0:1789760783.677084:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292288 00000100:00100000:0.0:1789760783.677088:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292288 00000100:00100000:0.0:1789760783.677110:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760783.677118:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083292416:12345-0@lo:400: 00000100:00100000:2.0:1789760783.677139:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3429:x1876700083291520:12345-0@lo:400: Request processed in 1711us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.677149:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789760783.677158:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083292416:12345-0@lo:400: Request processed in 40us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.677166:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760783.677201:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789760783.677207:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083292288:12345-0@lo:400: 00000100:00100000:0.0:1789760783.677238:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083292288:12345-0@lo:400: Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.677244:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789760783.677273:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760783.677301:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43b9f80 x1876700083292416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760783.677313:0:3428:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789760783.677328:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083292416:0@lo:400: 00010000:00080000:0.0:1789760783.677351:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43b8380 x1876700083292288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760783.677367:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083292288:0@lo:400: 00000100:00100000:3.0:1789760783.677433:0:6431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789760783.677444:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292032 00000100:00100000:2.0:1789760783.677449:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292032 00000100:00080000:0.0:1789760783.677472:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789760783.677483:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292160 00000100:00100000:2.0:1789760783.677487:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292160 00000100:00100000:2.0:1789760783.677510:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760783.677519:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3429:x1876700083292032:12345-0@lo:400: 00000100:00080000:0.0:1789760783.677558:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789760783.677575:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3429:x1876700083292032:12345-0@lo:400: Request processed in 57us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.677582:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760783.677604:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760783.677611:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3431:x1876700083292160:12345-0@lo:400: 00000100:00100000:2.0:1789760783.677666:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3431:x1876700083292160:12345-0@lo:400: Request processed in 56us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760783.677674:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789760783.679812:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43ba300 x1876700083291520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760783.679829:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3429:1876700083291520:0@lo:400: 00010000:00080000:1.0:1789760783.679897:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43b8a80 x1876700083292032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760783.679907:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3429:1876700083292032:0@lo:400: 00000100:00100000:1.0:1789760783.679920:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083291904:0@lo:400: 00000020:01000004:1.0:1789760783.680131:0:9040:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789760783.680146:0:9040:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff933098318000) 00000020:00000080:1.0:1789760783.680170:0:9040:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789760783.680281:0:9040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9330b47d7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760783.680285:0:9040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9330b47d7000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789760783.680287:0:9040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9330b47d7000 3 00010000:00080000:1.0:1789760783.680313:0:9040:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f8449b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.153@tcp at head 00010000:00080000:0.0:1789760783.680884:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43ba680 x1876700083292160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760783.680896:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3431:1876700083292160:0@lo:400: 00000100:00100000:0.0:1789760783.682317:0:9042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9042:1876700083292544:0@lo:901: 00000100:00100000:0.0:1789760783.682382:0:9042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.682452:0:9042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330864320c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789760783.682885:0:9040:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789760783.683083:0:9040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789760783.683119:0:9040:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789760783.683130:0:9040:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x838c7b3c022b75c5 00000100:00080000:1.0:1789760783.683138:0:9040:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760783.683143:0:9040:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff932f8449b800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1789760783.683166:0:9040:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff932f845b8a80 x1876700083292672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789760783.683214:0:9040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789760783.683534:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3427:1876700083292672:0@lo:38: 00000100:00100000:0.0:1789760783.683580:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.683670:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292672 00000100:00100000:1.0:1789760783.683735:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292672 00000100:00100000:1.0:1789760783.683770:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789760783.683777:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3427:x1876700083292672:12345-0@lo:38: 00010000:00080000:1.0:1789760783.683798:0:6431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1789760783.683826:0:6431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x838c7b3c022b75cc 00000004:00100000:1.0:1789760783.683841:0:6431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789760783.683870:0:6431:0:(import.c:65:import_set_state_nolock()) ffff932f8449e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760783.685683:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3427:x1876700083292672:12345-0@lo:38: Request processed in 1892us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.685695:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1789760783.685856:0:9040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1789760783.685908:0:9026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789760783.685938:0:9026:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760783.685954:0:9026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75a2 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.686064:0:9026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081650c00/0x838c7b3c022b759b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75a2 expref: -99 pid: 9026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789760783.686110:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789760783.686112:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760783.686113:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760783.686114:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760783.686116:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760783.686117:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760783.686118:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760783.686120:0:9026:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760783.686121:0:9026:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760783.686123:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760783.686124:0:9026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760783.686128:0:9026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789760783.686131:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789760783.686132:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760783.686134:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760783.686134:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760783.686135:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760783.686136:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760783.686137:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760783.686138:0:9026:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760783.686139:0:9026:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760783.686140:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760783.686141:0:9026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789760783.686162:0:9026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789760783.686177:0:9026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083292800:0@lo:253: 00000100:00100000:1.0:1789760783.686257:0:9026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.686282:0:9026:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852dbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760783.686312:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292800 00000100:00100000:1.0:1789760783.686318:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292800 00000100:00100000:1.0:1789760783.686351:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789760783.686358:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:9026:x1876700083292800:12345-0@lo:253: 20000000:01000000:1.0:1789760783.686380:0:6425:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789760783.686393:0:6425:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789760783.687089:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff932f845b8a80 x1876700083292672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789760793 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760783.687101:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760783.687109:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789760783.687116:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789760783.687121:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789760783.687124:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f8449b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789760783.687131:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3427:1876700083292672:0@lo:38: 00000100:00100000:3.0:1789760783.689159:0:6440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292544 00000100:00100000:3.0:1789760783.689171:0:6440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292544 00000100:00100000:3.0:1789760783.689238:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789760783.689248:0:6440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9042:x1876700083292544:12345-0@lo:901: 00000100:00080000:0.0:1789760783.689549:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789760783.689638:0:6440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9042:x1876700083292544:12345-0@lo:901: Request processed in 390us (7254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.689658:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789760783.689820:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1789760783.689857:0:9042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9330b43ba680 x1876700083292544/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789760799 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760783.689873:0:9042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9042:1876700083292544:0@lo:901: 20000000:01000000:0.0:1789760783.716490:0:6425:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789760783.716509:0:6425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789760783.717061:0:6445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789760783.717067:0:6445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789760783.717087:0:6445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717105:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717114:0:6445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717121:0:6445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717158:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717173:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.717225:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083292928:0@lo:104: 00000100:00100000:1.0:1789760783.717284:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760783.717331:0:6445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 17 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717357:0:6445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 17 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.717365:0:6445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083293056:0@lo:104: 00000100:00100000:1.0:1789760783.717389:0:6445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.717406:0:6445:0:(client.c:2715:ptlrpc_set_wait()) set ffff93309e9f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789760783.717690:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083292928 00000100:00100000:3.0:1789760783.717704:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083292928 00000100:00100000:3.0:1789760783.717747:0:6414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293056 00000100:00100000:3.0:1789760783.717750:0:6414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293056 00000100:00100000:3.0:1789760783.717767:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760783.717775:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083292928:12345-0@lo:104: 00010000:00010000:3.0:1789760783.717788:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.717844:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789760783.717850:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+4:6445:x1876700083292928:12345-0@lo:104: Request processed in 76us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.717857:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760783.717874:0:6414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760783.717881:0:6414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083293056:12345-0@lo:104: 00010000:00010000:3.0:1789760783.717889:0:6414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.717920:0:6414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789760783.717925:0:6414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:751d7670-4ea9-4485-a191-8db5c056760e+3:6445:x1876700083293056:12345-0@lo:104: Request processed in 46us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760783.717931:0:6414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789760783.717947:0:7700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789760783.717952:0:7700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.717960:0:7700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9330a7459e00 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760783.717964:0:7700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717973:0:6418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789760783.717980:0:6418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.717986:0:7700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.717989:0:6418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933080031000 already unused, calling callback (ffffffffc1a5bc20) 10000000:00010000:3.0:1789760783.717998:0:7700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760783.718004:0:7700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760783.718033:0:7700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.718041:0:7700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789760783.718059:0:7700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760783.718061:0:6418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.718079:0:7700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff9330a7459e00/0x838c7b3c022b7508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b750f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718081:0:6418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789760783.718098:0:6418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760783.718102:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760783.718105:0:6418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789760783.718106:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760783.718111:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.718126:0:6418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718132:0:6418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789760783.718161:0:6418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718168:0:6418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b74c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x838c7b3c022b74c9 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718210:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.718213:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789760783.718215:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760783.718226:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760783.718241:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b3d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083293312:0@lo:103: 00000100:00100000:1.0:1789760783.718243:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083293184:0@lo:103: 00000100:00100000:3.0:1789760783.718281:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.718315:0:7244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293312 00000100:00100000:1.0:1789760783.718320:0:7244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293312 00010000:00010000:1.0:1789760783.718339:0:7244:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.718370:0:7244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760783.718377:0:7244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+18:3431:x1876700083293312:12345-0@lo:103: 00010000:00010000:1.0:1789760783.718387:0:7244:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760783.718392:0:7244:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718402:0:7244:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.718416:0:7244:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760783.718451:0:7244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:751d7670-4ea9-4485-a191-8db5c056760e+18:3431:x1876700083293312:12345-0@lo:103: Request processed in 74us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.718457:0:7244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760783.718478:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.718505:0:6415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293184 00000100:00100000:1.0:1789760783.718508:0:6415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293184 00010000:00010000:1.0:1789760783.718519:0:6415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 18 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.718701:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b3d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083293312:0@lo:103: 00000100:00100000:0.0:1789760783.719259:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083292928:0@lo:104: 00010000:00010000:0.0:1789760783.719273:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081651400/0x838c7b3c022b74c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b74c2 expref: 18 pid: 6425 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760783.719296:0:6445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6445:1876700083293056:0@lo:104: 00010000:00010000:0.0:1789760783.719316:0:6445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760783.720212:0:6415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760783.720227:0:6415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+17:3429:x1876700083293184:12345-0@lo:103: 00010000:00010000:1.0:1789760783.720243:0:6415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789760783.720250:0:6415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720264:0:6415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720280:0:6415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9330a7458e00/0x838c7b3c022b750f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x838c7b3c022b7508 expref: 17 pid: 6422 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720294:0:6415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720302:0:6415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789760783.720318:0:6415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003251748s 00010000:00010000:1.0:1789760783.720323:0:6415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720331:0:6415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720338:0:6415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720346:0:6415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720361:0:6415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933081651600 already unused, calling callback (ffffffffc1470350) 00010000:00010000:1.0:1789760783.720366:0:6415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720374:0:6415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720393:0:6415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720403:0:6415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789760783.720466:0:6415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:751d7670-4ea9-4485-a191-8db5c056760e+16:3429:x1876700083293184:12345-0@lo:103: Request processed in 243us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.720473:0:6415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789760783.720498:0:6445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720506:0:6445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760783.720513:0:6445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff933081651600/0x838c7b3c022b75d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760783.720637:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083293184:0@lo:103: 00000100:00100000:0.0:1789760783.731857:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+15:9026:x1876700083292800:12345-0@lo:253: Request processed in 45489us (45590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.731873:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789760783.731957:0:9026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:751d7670-4ea9-4485-a191-8db5c056760e:9026:1876700083292800:0@lo:253: 10000000:01000000:1.0:1789760783.732094:0:9026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789760783.732097:0:9026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789760783.732099:0:9026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789760783.732100:0:9026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789760783.732102:0:9026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789760783.732103:0:9026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789760783.732118:0:9026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789760783.732120:0:9026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789760783.732121:0:9026:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789760783.732123:0:9026:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789760783.732124:0:9026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789760783.732125:0:9026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789760783.732140:0:9026:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789760783.738901:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760783.739772:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760783.739993:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760783.740210:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789760783.741241:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789760783.741638:0:9026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789760783.743685:0:9026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789760783.750467:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083293568:0@lo:13: 00000100:00100000:0.0:1789760783.750533:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760783.750588:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293568 00000100:00100000:0.0:1789760783.750595:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293568 00000100:00100000:0.0:1789760783.750638:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789760783.750657:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083293568:12345-0@lo:13: 00002000:00000024:0.0:1789760783.750703:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760783.750747:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083293568:12345-0@lo:13: Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760783.750754:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789760783.750793:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b9880 x1876700083293568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760783.750826:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083293568:0@lo:13: 00000100:00100000:0.0:1789760783.750856:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083293440:0@lo:13: 00000100:00100000:0.0:1789760783.750884:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760783.750899:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293440 00000100:00100000:1.0:1789760783.750905:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293440 00000100:00100000:1.0:1789760783.750988:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760783.750998:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083293440:12345-0@lo:13: 00002000:00000024:1.0:1789760783.751010:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760783.751092:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083293440:12345-0@lo:13: Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760783.751098:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789760783.751225:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b8700 x1876700083293440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760783.751241:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083293440:0@lo:13: 00002000:00080000:2.0:1789760783.907107:0:9026:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789760783.907116:0:9026:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789760783.907149:0:9026:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789760783.907226:0:9026:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789760783.907242:0:9026:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789760783.907266:0:9026:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1789760784.262432:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760784.262457:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083293696:0@lo:41: 00000100:00100000:1.0:1789760784.262522:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760784.262700:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293696 00000100:00100000:3.0:1789760784.262709:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293696 00000100:00100000:3.0:1789760784.262759:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789760784.262782:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083293696:12345-0@lo:41: 00000004:00000024:3.0:1789760784.262823:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760784.262878:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083293696:12345-0@lo:41: Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760784.262886:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789760784.262970:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083293696:0@lo:41: 00010000:00010000:3.0:1789760784.714233:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760785.734351:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760786.762230:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760787.335505:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083293824:0@lo:41: 00000100:00100000:1.0:1789760787.335633:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760787.335746:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293824 00000100:00100000:0.0:1789760787.335754:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293824 00000100:00100000:0.0:1789760787.335804:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789760787.335814:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083293824:12345-0@lo:41: 00000004:00000024:0.0:1789760787.335876:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789760787.335946:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b3d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083293824:12345-0@lo:41: Request processed in 127us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760787.335954:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760787.336168:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083293824:0@lo:41: 00010000:00010000:3.0:1789760787.784761:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760788.806462:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789760788.870311:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789760788.870318:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9330b4757000 from 39 10000000:01000000:1.0:1789760788.870324:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000100:00100000:2.0:1789760788.870328:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083293952:0@lo:13: 00010000:00010000:1.0:1789760788.870362:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.870369:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083294336:0@lo:400: 00010000:00010000:1.0:1789760788.870386:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.870397:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789760788.870401:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.870402:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.870422:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295104:0@lo:101: 00000100:00100000:0.0:1789760788.870456:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3429:1876700083294848:0@lo:400: 00000100:00100000:3.0:1789760788.870900:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083294464:0@lo:400: 00000100:00100000:3.0:1789760788.873229:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873273:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083294976:0@lo:400: 00000100:00100000:3.0:1789760788.873310:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873346:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789760788.873368:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083294592:0@lo:400: 00000100:00100000:3.0:1789760788.873391:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873408:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083295232:0@lo:400: 00000100:00100000:3.0:1789760788.873423:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873449:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294976 00000100:00100000:3.0:1789760788.873456:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294976 00000100:00100000:3.0:1789760788.873498:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295232 00000100:00100000:3.0:1789760788.873501:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295232 00000100:00100000:3.0:1789760788.873518:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789760788.873527:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083294976:12345-0@lo:400: 00000100:00100000:1.0:1789760788.873556:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873584:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083294976:12345-0@lo:400: Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.873592:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789760788.873595:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330853ff240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.873636:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789760788.873643:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083295232:12345-0@lo:400: 00000100:00100000:1.0:1789760788.873652:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083294208:0@lo:400: 00000100:00100000:3.0:1789760788.873679:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083295232:12345-0@lo:400: Request processed in 35us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.873686:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789760788.873691:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873705:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294336 00000100:00100000:3.0:1789760788.873709:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294336 00000100:00100000:1.0:1789760788.873730:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083294720:0@lo:400: 00000100:00100000:3.0:1789760788.873732:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294592 00000100:00100000:3.0:1789760788.873736:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294592 00000100:00100000:1.0:1789760788.873761:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873768:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760788.873775:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083294336:12345-0@lo:400: 00000100:00100000:1.0:1789760788.873786:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3428:1876700083295360:0@lo:400: 00000100:00100000:3.0:1789760788.873815:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083294336:12345-0@lo:400: Request processed in 40us (3412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.873823:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.873827:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760788.873841:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789760788.873847:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083294592:12345-0@lo:400: 00000100:00100000:1.0:1789760788.873863:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294464 00000100:00100000:1.0:1789760788.873868:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294464 00000100:00100000:3.0:1789760788.873874:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083294592:12345-0@lo:400: Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.873881:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789760788.873897:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294208 00000100:00100000:1.0:1789760788.873902:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294208 00000100:00080000:3.0:1789760788.873902:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760788.873920:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294720 00000100:00100000:1.0:1789760788.873923:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294720 00000100:00100000:1.0:1789760788.873942:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295360 00000100:00100000:1.0:1789760788.873944:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295360 00000100:00100000:1.0:1789760788.873959:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789760788.873966:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330ba16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083294464:12345-0@lo:400: 00000100:00100000:1.0:1789760788.874004:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330ba16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3430:x1876700083294464:12345-0@lo:400: Request processed in 38us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.874023:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789760788.874037:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083294592:0@lo:400: 00000100:00100000:1.0:1789760788.874041:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789760788.874051:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309ea4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083294208:12345-0@lo:400: 00010000:00080000:3.0:1789760788.874054:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43ba300 x1876700083295232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760788.874066:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083295232:0@lo:400: 00010000:00080000:3.0:1789760788.874078:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43bad80 x1876700083294464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760788.874093:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309ea4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083294208:12345-0@lo:400: Request processed in 43us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874107:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3430:1876700083294464:0@lo:400: 00000100:00100000:1.0:1789760788.874108:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789760788.874125:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b8a80 x1876700083294976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760788.874130:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789760788.874139:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083294976:0@lo:400: 00000100:00100000:1.0:1789760788.874144:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309ea4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083294720:12345-0@lo:400: 00000100:00100000:1.0:1789760788.874178:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309ea4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083294720:12345-0@lo:400: Request processed in 39us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874249:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083293952 00000100:00100000:3.0:1789760788.874253:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083293952 00000100:00100000:3.0:1789760788.874275:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760788.874281:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083293952:12345-0@lo:13: 00002000:00000024:3.0:1789760788.874306:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760788.874336:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083293952:12345-0@lo:13: Request processed in 55us (3942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874342:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789760788.874366:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff933087c94700 x1876700083293952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760788.874382:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083293952:0@lo:13: 00000100:00100000:3.0:1789760788.874389:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083294080:0@lo:400: 00000100:00100000:3.0:1789760788.874411:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.874444:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295104 00000100:00100000:3.0:1789760788.874447:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295104 00000100:00100000:3.0:1789760788.874465:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294080 00000100:00100000:3.0:1789760788.874467:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294080 00000100:00100000:3.0:1789760788.874476:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760788.874482:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083295104:12345-0@lo:101: 00010000:00010000:3.0:1789760788.874490:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760788.874510:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080030000/0x838c7b3c022b75e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b75da expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.874532:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080030000/0x838c7b3c022b75e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b75da expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.874544:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080030000/0x838c7b3c022b75e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b75da expref: 17 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.874553:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080030000, rc 0) 00000100:00100000:3.0:1789760788.874579:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083295104:12345-0@lo:101: Request processed in 97us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874584:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789760788.874605:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789760788.874624:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:3431:x1876700083294080:12345-0@lo:400: 00000100:00100000:3.0:1789760788.874656:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:3431:x1876700083294080:12345-0@lo:400: Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874661:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789760788.874693:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083294080:0@lo:400: 00000100:00100000:3.0:1789760788.874732:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789760788.874740:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309ea4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3428:x1876700083295360:12345-0@lo:400: 00000100:00100000:3.0:1789760788.874775:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309ea4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3428:x1876700083295360:12345-0@lo:400: Request processed in 36us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.874787:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789760788.874801:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789760788.874834:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295104:0@lo:101: 00010000:00010000:1.0:1789760788.874848:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75e1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.874859:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b75e1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.874913:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295616:0@lo:501: 00000100:00100000:1.0:1789760788.874940:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.874961:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330853ff240 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.874972:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295616 00000100:00100000:1.0:1789760788.874976:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295616 00000100:00100000:1.0:1789760788.874998:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789760788.875004:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083295616:12345-0@lo:501: 00000100:00080000:2.0:1789760788.875439:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789760788.875524:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43bbb80 x1876700083294208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760788.875535:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083294208:0@lo:400: 00010000:00080000:2.0:1789760788.875544:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43ba680 x1876700083294720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760788.875552:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083294720:0@lo:400: 00010000:00080000:2.0:1789760788.875561:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f845b8700 x1876700083295360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789760788.875580:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3428:1876700083295360:0@lo:400: 00000100:00100000:3.0:1789760788.876086:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083295744:0@lo:13: 00000100:00100000:1.0:1789760788.877508:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083295616:12345-0@lo:501: Request processed in 2498us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.877533:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789760788.877677:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.877724:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295744 00000100:00100000:3.0:1789760788.877736:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295744 00000100:00100000:3.0:1789760788.877781:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760788.877789:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083295744:12345-0@lo:13: 00002000:00000024:3.0:1789760788.877808:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760788.877849:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083295744:12345-0@lo:13: Request processed in 62us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.877855:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789760788.877892:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330ba16ed80 x1876700083295744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760788.877909:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083295744:0@lo:13: 00000100:00100000:2.0:1789760788.878839:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295616:0@lo:501: 00000100:00100000:2.0:1789760788.878881:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295872:0@lo:503: 00000100:00100000:2.0:1789760788.878923:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.878946:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330bddcaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.881219:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295872 00000100:00100000:1.0:1789760788.881231:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295872 00000100:00100000:1.0:1789760788.881286:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760788.881296:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083295872:12345-0@lo:503: 00000100:00100000:1.0:1789760788.881693:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083295872:12345-0@lo:503: Request processed in 398us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.881700:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789760788.881765:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083295872:0@lo:503: 00000100:00100000:1.0:1789760788.881950:0:9360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9360:1876700083296000:0@lo:502: 00000100:00100000:0.0:1789760788.883244:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.883340:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3429:1876700083295488:0@lo:400: 00000100:00100000:0.0:1789760788.883384:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.883555:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083294336:0@lo:400: 00000100:00100000:0.0:1789760788.883588:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083294848 00000100:00100000:0.0:1789760788.883593:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083294848 00000100:00100000:0.0:1789760788.883750:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083295488 00000100:00100000:0.0:1789760788.883754:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083295488 00000100:00100000:0.0:1789760788.883776:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760788.883784:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f845b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3429:x1876700083294848:12345-0@lo:400: 00000100:00100000:0.0:1789760788.883832:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f845b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3429:x1876700083294848:12345-0@lo:400: Request processed in 48us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.883846:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789760788.883865:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789760788.883872:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3429:x1876700083295488:12345-0@lo:400: 00000100:00100000:0.0:1789760788.883896:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3429:x1876700083295488:12345-0@lo:400: Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.883901:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789760788.883932:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43bb800 x1876700083294848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760788.883943:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3429:1876700083294848:0@lo:400: 00010000:00080000:0.0:1789760788.883952:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f845b9c00 x1876700083295488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760788.883959:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3429:1876700083295488:0@lo:400: 00000100:00080000:2.0:1789760788.884376:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760788.885028:0:9360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.885070:0:9360:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.885168:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296000 00000100:00100000:3.0:1789760788.885176:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296000 00000100:00100000:3.0:1789760788.885272:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789760788.885279:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:9360:x1876700083296000:12345-0@lo:502: 00000100:00100000:3.0:1789760788.885789:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+16:9360:x1876700083296000:12345-0@lo:502: Request processed in 508us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.885797:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789760788.887329:0:9360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9360:1876700083296000:0@lo:502: 00000100:00100000:3.0:1789760788.887502:0:9360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9360:1876700083296128:0@lo:502: 00000100:00100000:3.0:1789760788.887572:0:9360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.887655:0:9360:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.887699:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296128 00000100:00100000:2.0:1789760788.887705:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296128 00000100:00100000:2.0:1789760788.887778:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789760788.887788:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9360:x1876700083296128:12345-0@lo:502: 00000100:00100000:2.0:1789760788.888014:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+16:9360:x1876700083296128:12345-0@lo:502: Request processed in 228us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.888022:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789760788.888591:0:9360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9360:1876700083296128:0@lo:502: 00000040:00080000:3.0:1789760788.888629:0:9360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789760788.888791:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789760788.888809:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789760788.888819:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75e1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.888829:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081651600/0x838c7b3c022b75da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75e1 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789760788.888838:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789760788.888841:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789760788.888843:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789760788.888869:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.888877:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.888894:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.888909:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296256:0@lo:101: 00000100:00100000:1.0:1789760788.888943:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.888975:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.889268:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296256 00000100:00100000:3.0:1789760788.889275:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296256 00000100:00100000:3.0:1789760788.889305:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789760788.889313:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+16:6427:x1876700083296256:12345-0@lo:101: 00010000:00010000:3.0:1789760788.889331:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760788.889342:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080031400/0x838c7b3c022b75ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b75e8 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.889362:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080031400/0x838c7b3c022b75ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b75e8 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.889372:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080031400/0x838c7b3c022b75ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b75e8 expref: 17 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.889380:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080031400, rc 0) 00000100:00100000:3.0:1789760788.889413:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296256:12345-0@lo:101: Request processed in 101us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.889420:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789760788.889556:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296256:0@lo:101: 00010000:00010000:1.0:1789760788.889568:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75ef expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.889577:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b75ef expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789760788.889631:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296384:0@lo:501: 00000100:00100000:1.0:1789760788.889657:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.889678:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933087df0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.889690:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296384 00000100:00100000:1.0:1789760788.889693:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296384 00000100:00100000:1.0:1789760788.889711:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789760788.889716:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296384:12345-0@lo:501: 00000100:00100000:1.0:1789760788.889954:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296384:12345-0@lo:501: Request processed in 237us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.889960:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789760788.890139:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296384:0@lo:501: 00000100:00100000:0.0:1789760788.890167:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296512:0@lo:503: 00000100:00100000:0.0:1789760788.890228:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.890257:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090779480 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.890782:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296512 00000100:00100000:2.0:1789760788.890788:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296512 00000100:00100000:2.0:1789760788.890822:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789760788.890829:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296512:12345-0@lo:503: 00000100:00100000:2.0:1789760788.891142:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296512:12345-0@lo:503: Request processed in 313us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.891149:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789760788.891677:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296512:0@lo:503: 00000100:00100000:3.0:1789760788.892519:0:9363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9363:1876700083296640:0@lo:502: 00000100:00100000:3.0:1789760788.892654:0:9363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.893350:0:9363:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.893369:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296640 00000100:00100000:1.0:1789760788.893376:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296640 00000100:00100000:1.0:1789760788.893527:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789760788.893538:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:9363:x1876700083296640:12345-0@lo:502: 00000100:00100000:1.0:1789760788.893810:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+17:9363:x1876700083296640:12345-0@lo:502: Request processed in 273us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.893818:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789760788.893940:0:9363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9363:1876700083296640:0@lo:502: 00000020:01000000:3.0:1789760788.893973:0:9363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760788.893982:0:9363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760788.893985:0:9363:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760788.893989:0:9363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760788.893992:0:9363:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760788.894014:0:9363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9363:1876700083296768:0@lo:502: 00000100:00100000:3.0:1789760788.894055:0:9363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.894361:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296768 00000100:00100000:2.0:1789760788.894366:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296768 00000100:00100000:3.0:1789760788.894386:0:9363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5e6d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.894390:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789760788.894397:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9363:x1876700083296768:12345-0@lo:502: 00000100:00100000:2.0:1789760788.894541:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:9363:x1876700083296768:12345-0@lo:502: Request processed in 144us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.894548:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789760788.895327:0:9363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9363:1876700083296768:0@lo:502: 00000020:01000000:3.0:1789760788.895359:0:9363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760788.895365:0:9363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760788.895367:0:9363:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760788.895371:0:9363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789760788.895658:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789760788.895685:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789760788.895695:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75ef expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.895705:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933081651400/0x838c7b3c022b75e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75ef expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760788.895715:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789760788.895721:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933099616800 from 39 10000000:01000000:0.0:1789760788.895724:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789760788.895755:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.895762:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.895771:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.895789:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296896:0@lo:101: 00000100:00100000:0.0:1789760788.895835:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.895863:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.896232:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083296896 00000100:00100000:1.0:1789760788.896240:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083296896 00000100:00100000:1.0:1789760788.896297:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789760788.896307:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+17:6427:x1876700083296896:12345-0@lo:101: 00010000:00010000:1.0:1789760788.896319:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760788.896335:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650e00/0x838c7b3c022b75fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b75f6 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.896518:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650e00/0x838c7b3c022b75fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b75f6 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.896530:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650e00/0x838c7b3c022b75fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b75f6 expref: 18 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.896540:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650e00, rc 0) 00000100:00100000:1.0:1789760788.896587:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083296896:12345-0@lo:101: Request processed in 282us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.896594:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789760788.896687:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083296896:0@lo:101: 00010000:00010000:0.0:1789760788.896700:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75fd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.896710:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b75fd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.896759:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297024:0@lo:501: 00000100:00100000:0.0:1789760788.896792:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.896820:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.896931:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297024 00000100:00100000:1.0:1789760788.896939:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297024 00000100:00100000:1.0:1789760788.897134:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789760788.897142:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083297024:12345-0@lo:501: 00000100:00100000:1.0:1789760788.897421:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083297024:12345-0@lo:501: Request processed in 279us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.897428:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789760788.898578:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297024:0@lo:501: 00000100:00100000:0.0:1789760788.898637:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297152:0@lo:503: 00000100:00100000:0.0:1789760788.898690:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.898716:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.899205:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297152 00000100:00100000:1.0:1789760788.899212:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297152 00000100:00100000:1.0:1789760788.899258:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760788.899267:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083297152:12345-0@lo:503: 00000100:00100000:1.0:1789760788.899452:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083297152:12345-0@lo:503: Request processed in 185us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.899460:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789760788.899512:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297152:0@lo:503: 00000100:00100000:1.0:1789760788.899735:0:9365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9365:1876700083297280:0@lo:502: 00000100:00100000:1.0:1789760788.899771:0:9365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.899792:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297280 00000100:00100000:1.0:1789760788.899796:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297280 00000100:00100000:1.0:1789760788.899817:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760788.899823:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:9365:x1876700083297280:12345-0@lo:502: 00000100:00100000:1.0:1789760788.899977:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:9365:x1876700083297280:12345-0@lo:502: Request processed in 152us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.899983:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789760788.900019:0:9365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5c64180 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.900032:0:9365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9365:1876700083297280:0@lo:502: 00000100:00100000:1.0:1789760788.900067:0:9365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9365:1876700083297408:0@lo:502: 00000100:00100000:1.0:1789760788.900097:0:9365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760788.900117:0:9365:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b5c64180 going to sleep for 11 seconds 00000100:00100000:0.0:1789760788.900693:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297408 00000100:00100000:0.0:1789760788.900699:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297408 00000100:00100000:0.0:1789760788.900735:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789760788.900742:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:9365:x1876700083297408:12345-0@lo:502: 00000100:00100000:0.0:1789760788.902034:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+18:9365:x1876700083297408:12345-0@lo:502: Request processed in 1286us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.902044:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789760788.902159:0:9365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9365:1876700083297408:0@lo:502: 00000040:00080000:1.0:1789760788.902259:0:9365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789760788.902458:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789760788.902477:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789760788.902487:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75fd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.902498:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7459400/0x838c7b3c022b75f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b75fd expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760788.902507:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789760788.902509:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933099616800 from 6 10000000:01000000:0.0:1789760788.902512:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789760788.902541:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.902548:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.902557:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.902583:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297536:0@lo:101: 00000100:00100000:0.0:1789760788.902630:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.902662:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.902984:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297536 00000100:00100000:1.0:1789760788.902996:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297536 00000100:00100000:1.0:1789760788.903044:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789760788.903053:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+18:6427:x1876700083297536:12345-0@lo:101: 00010000:00010000:1.0:1789760788.903064:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789760788.903077:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933081650800/0x838c7b3c022b760b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7604 expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.903097:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933081650800/0x838c7b3c022b760b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7604 expref: 19 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.903106:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933081650800/0x838c7b3c022b760b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7604 expref: 19 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789760788.903114:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933081650800, rc 0) 00000100:00100000:1.0:1789760788.903153:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e991050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083297536:12345-0@lo:101: Request processed in 102us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.903159:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789760788.903908:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297536:0@lo:101: 00010000:00010000:0.0:1789760788.903925:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b760b expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.903935:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b760b expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.903989:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297664:0@lo:256: 00000100:00100000:0.0:1789760788.904025:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.904052:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.904510:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297664 00000100:00100000:2.0:1789760788.904515:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297664 00000100:00100000:2.0:1789760788.904551:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760788.904559:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083297664:12345-0@lo:256: 20000000:01000000:2.0:1789760788.904668:0:6424:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760788.904687:0:6424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760788.904691:0:6424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789760788.904771:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083297664:12345-0@lo:256: Request processed in 212us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.904942:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297664:0@lo:256: 10000000:01000000:0.0:1789760788.904996:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760788.905004:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b760b expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.905012:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7459200/0x838c7b3c022b7604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b760b expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760788.905021:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789760788.905023:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789760788.905025:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789760788.905045:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.905051:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.905059:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.905082:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297792:0@lo:101: 00000100:00100000:0.0:1789760788.905110:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.905137:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.905171:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789760788.905215:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297792 00000100:00100000:2.0:1789760788.905219:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297792 00000100:00100000:2.0:1789760788.905241:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760788.905247:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+19:6427:x1876700083297792:12345-0@lo:101: 00010000:00010000:2.0:1789760788.905254:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760788.905264:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7612 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.905280:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7612 expref: 20 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.905290:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f9e00/0x838c7b3c022b7619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7612 expref: 20 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.905296:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f9e00, rc 0) 00000100:00100000:2.0:1789760788.905334:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083297792:12345-0@lo:101: Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.905340:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789760788.905369:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297792:0@lo:101: 00010000:00010000:2.0:1789760788.906923:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7619 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.906938:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7619 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.907006:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297920:0@lo:501: 00000100:00100000:2.0:1789760788.907046:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.907114:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330bddcaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760788.909889:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083297920 00000100:00100000:0.0:1789760788.909904:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083297920 00000100:00100000:0.0:1789760788.909954:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789760788.909964:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083297920:12345-0@lo:501: 00000100:00100000:0.0:1789760788.910275:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083297920:12345-0@lo:501: Request processed in 311us (3227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.910283:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789760788.910495:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083297920:0@lo:501: 00000100:00100000:3.0:1789760788.910545:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298048:0@lo:503: 00000100:00100000:3.0:1789760788.910593:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.910640:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.910648:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298048 00000100:00100000:2.0:1789760788.910652:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298048 00000100:00100000:2.0:1789760788.910692:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789760788.910700:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083298048:12345-0@lo:503: 00000100:00100000:2.0:1789760788.910995:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083298048:12345-0@lo:503: Request processed in 295us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.911001:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789760788.911031:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298048:0@lo:503: 00000100:00100000:2.0:1789760788.921975:0:9366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9366:1876700083298176:0@lo:502: 00000100:00100000:2.0:1789760788.922057:0:9366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.922104:0:9366:0:(client.c:2715:ptlrpc_set_wait()) set ffff93308535c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.922988:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298176 00000100:00100000:3.0:1789760788.922998:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298176 00000100:00100000:3.0:1789760788.923142:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789760788.923151:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+20:9366:x1876700083298176:12345-0@lo:502: 00000100:00100000:3.0:1789760788.923493:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+20:9366:x1876700083298176:12345-0@lo:502: Request processed in 342us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.923502:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789760788.923737:0:9366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9366:1876700083298176:0@lo:502: 00000020:01000000:2.0:1789760788.923766:0:9366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789760788.923773:0:9366:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt2/mdt2 00000020:00000080:2.0:1789760788.923847:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760788.923855:0:9366:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789760788.923860:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789760788.923864:0:9366:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:2.0:1789760788.923882:0:9366:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789760788.923885:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760788.923898:0:9366:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9330bf1d19b8) 00000020:00000080:2.0:1789760788.923920:0:9366:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789760788.923924:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789760788.923991:0:9366:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789760788.923996:0:9366:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789760788.924002:0:9366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x838c7b3c022b7627 00010000:00080000:2.0:1789760788.924035:0:9366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f85c9f000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.153@tcp at head 00010000:00010000:2.0:1789760788.924433:0:9366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789760788.924761:0:9366:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789760788.924849:0:9366:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789760788.926238:0:9366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760788.926970:0:9366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760788.927025:0:9366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789760788.927077:0:9366:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789760788.932336:0:9368:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789760788.932344:0:9368:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789760788.939550:0:9366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789760788.939566:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789760788.939604:0:9366:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789760788.939638:0:9366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b762e 00000100:00080000:3.0:1789760788.939648:0:9366:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789760788.939654:0:9366:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff932f85c9f000 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:3.0:1789760788.939689:0:9366:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9330b43bbb80 x1876700083298304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789760788.939714:0:9366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789760788.939772:0:9366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760788.939782:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1789760788.939784:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083298304:0@lo:8: 00000020:00000080:3.0:1789760788.939784:0:9366:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789760788.939788:0:9366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789760788.939791:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760788.939792:0:9366:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789760788.939795:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789760788.939796:0:9366:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789760788.939819:0:9366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9366:1876700083298432:0@lo:502: 00000100:00100000:0.0:1789760788.939854:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.939859:0:9366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.939922:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298432 00000100:00100000:2.0:1789760788.939930:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298432 00000100:00100000:0.0:1789760788.939962:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298304 00000100:00100000:0.0:1789760788.939966:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298304 00000100:00100000:2.0:1789760788.939970:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789760788.939978:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:9366:x1876700083298432:12345-0@lo:502: 00000100:00100000:0.0:1789760788.940000:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789760788.940005:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3427:x1876700083298304:12345-0@lo:8: 00010000:00080000:0.0:1789760788.940024:0:8074:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1789760788.940047:0:8074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x838c7b3c022b7635 00000100:00100000:3.0:1789760788.940264:0:9366:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00002000:00100000:0.0:1789760788.942142:0:8074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff932f8462c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789760788.942154:0:8074:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789760788.942158:0:8074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789760788.942298:0:8074:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789760788.943315:0:8074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789760788.943345:0:8074:0:(import.c:65:import_set_state_nolock()) ffff932f8462d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789760788.943549:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3427:x1876700083298304:12345-0@lo:8: Request processed in 3540us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.943564:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789760788.943637:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43bbb80 x1876700083298304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760788.943648:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760788.943655:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789760788.943663:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789760788.943668:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789760788.943671:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f85c9f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789760788.943682:0:3427:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789760788.943686:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3427:1876700083298304:0@lo:8: 00000100:00100000:0.0:1789760788.943739:0:9370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083298560:0@lo:700: 00000100:00100000:0.0:1789760788.943771:0:9370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.943803:0:8084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298560 00000100:00100000:0.0:1789760788.943807:0:8084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298560 00000100:00100000:0.0:1789760788.943855:0:8084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789760788.943862:0:8084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9370:x1876700083298560:12345-0@lo:700: 00000100:00100000:0.0:1789760788.943891:0:8084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8084:1876700083298688:0@lo:700: 00000100:00100000:0.0:1789760788.943917:0:8084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.943935:0:8084:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090779b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789760788.943947:0:9370:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330907790c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789760788.946883:0:9368:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1789760788.947591:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789760788.948654:0:9368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 176173470690ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789760788.948697:0:6436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298688 00000100:00100000:1.0:1789760788.948705:0:6436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298688 00000100:00100000:1.0:1789760788.948759:0:6436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789760788.948769:0:6436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8084:x1876700083298688:12345-0@lo:700: 00000100:00100000:2.0:1789760788.950700:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+20:9366:x1876700083298432:12345-0@lo:502: Request processed in 10712us (10830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.950716:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789760788.953291:0:9366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9366:1876700083298432:0@lo:502: 00000020:01000000:3.0:1789760788.953376:0:9366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789760788.953402:0:9366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789760788.953405:0:9366:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789760788.953410:0:9366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789760788.953511:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789760788.953529:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789760788.953539:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7619 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953550:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7458800/0x838c7b3c022b7612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7619 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789760788.953560:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789760788.953563:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933087a7b000 from 39 10000000:01000000:3.0:1789760788.953566:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789760788.953594:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953602:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953633:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760788.953653:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298816:0@lo:101: 00000100:00100000:3.0:1789760788.953719:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.953751:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.953771:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298816 00000100:00100000:3.0:1789760788.953776:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298816 00000100:00100000:3.0:1789760788.953818:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789760788.953827:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+20:6427:x1876700083298816:12345-0@lo:101: 00010000:00010000:3.0:1789760788.953852:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760788.953864:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080031e00/0x838c7b3c022b7643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b763c expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953886:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080031e00/0x838c7b3c022b7643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b763c expref: 21 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953895:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080031e00/0x838c7b3c022b7643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b763c expref: 21 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.953903:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080031e00, rc 0) 00000100:00100000:3.0:1789760788.953939:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083298816:12345-0@lo:101: Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.953946:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789760788.953981:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298816:0@lo:101: 00010000:00010000:3.0:1789760788.956171:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7643 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760788.956217:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7643 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789760788.956292:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298944:0@lo:501: 00000100:00100000:3.0:1789760788.956348:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.956412:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.956432:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083298944 00000100:00100000:3.0:1789760788.956437:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083298944 00000100:00100000:3.0:1789760788.956469:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789760788.956477:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083298944:12345-0@lo:501: 00000100:00100000:3.0:1789760788.956698:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083298944:12345-0@lo:501: Request processed in 221us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.956707:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789760788.956746:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083298944:0@lo:501: 00000100:00100000:3.0:1789760788.956775:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299072:0@lo:503: 00000100:00100000:3.0:1789760788.956812:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760788.956825:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b46dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789760788.956836:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299072 00000100:00100000:3.0:1789760788.956839:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299072 00000100:00100000:3.0:1789760788.956855:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789760788.956860:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083299072:12345-0@lo:503: 00000100:00100000:3.0:1789760788.957010:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085230c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083299072:12345-0@lo:503: Request processed in 149us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760788.957017:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789760788.957052:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299072:0@lo:503: 00000100:00100000:0.0:1789760788.963471:0:9375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9375:1876700083299200:0@lo:502: 00000100:00100000:0.0:1789760788.963547:0:9375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.963588:0:9375:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.964286:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299200 00000100:00100000:1.0:1789760788.964294:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299200 00000100:00100000:1.0:1789760788.964335:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789760788.964343:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:9375:x1876700083299200:12345-0@lo:502: 00000100:00100000:1.0:1789760788.964596:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+21:9375:x1876700083299200:12345-0@lo:502: Request processed in 252us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.964603:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789760788.964618:0:9375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9375:1876700083299200:0@lo:502: 00000100:00100000:0.0:1789760788.964669:0:9375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9375:1876700083299328:0@lo:502: 00000100:00100000:0.0:1789760788.964710:0:9375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.964726:0:9375:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.964884:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299328 00000100:00100000:2.0:1789760788.964888:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299328 00000100:00100000:2.0:1789760788.964912:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789760788.964918:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+21:9375:x1876700083299328:12345-0@lo:502: 00000100:00100000:2.0:1789760788.966463:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+21:9375:x1876700083299328:12345-0@lo:502: Request processed in 1541us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.966471:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789760788.966958:0:9375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9375:1876700083299328:0@lo:502: 00000040:00080000:0.0:1789760788.967451:0:9375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789760788.970578:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789760788.970621:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789760788.970632:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7643 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.970645:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff933080031000/0x838c7b3c022b763c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7643 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760788.970655:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789760788.970658:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933087a7b000 from 6 10000000:01000000:2.0:1789760788.970660:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789760788.970692:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.970700:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.970710:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.970733:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299456:0@lo:101: 00000100:00100000:2.0:1789760788.970797:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.970834:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.970853:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299456 00000100:00100000:2.0:1789760788.970859:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299456 00000100:00100000:2.0:1789760788.970899:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789760788.970909:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+21:6427:x1876700083299456:12345-0@lo:101: 00010000:00010000:2.0:1789760788.970928:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760788.970940:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f9600/0x838c7b3c022b7651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b764a expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.970963:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f9600/0x838c7b3c022b7651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b764a expref: 22 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.970974:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f9600/0x838c7b3c022b7651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b764a expref: 22 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.971046:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f9600, rc 0) 00000100:00100000:2.0:1789760788.971090:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+22:6427:x1876700083299456:12345-0@lo:101: Request processed in 183us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.971097:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789760788.971142:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299456:0@lo:101: 00010000:00010000:2.0:1789760788.971155:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7651 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.971164:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7651 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.971233:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299584:0@lo:256: 00000100:00100000:2.0:1789760788.971262:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.971276:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.971288:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299584 00000100:00100000:2.0:1789760788.971291:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299584 00000100:00100000:2.0:1789760788.971311:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789760788.971316:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+22:6427:x1876700083299584:12345-0@lo:256: 20000000:01000000:2.0:1789760788.971337:0:6422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789760788.971351:0:6422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789760788.971354:0:6422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789760788.971708:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085231c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+22:6427:x1876700083299584:12345-0@lo:256: Request processed in 389us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.971715:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789760788.971771:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c97100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299584:0@lo:256: 10000000:01000000:0.0:1789760788.971819:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789760788.971826:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7651 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.971834:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330814f8e00/0x838c7b3c022b764a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7651 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789760788.971841:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789760788.971843:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789760788.971845:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789760788.971862:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.971868:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.971875:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789760788.971886:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299712:0@lo:101: 00000100:00100000:0.0:1789760788.971911:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760788.971925:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789760788.971937:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299712 00000100:00100000:0.0:1789760788.971947:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299712 00000100:00100000:0.0:1789760788.971972:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789760788.971978:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+22:6427:x1876700083299712:12345-0@lo:101: 00010000:00010000:0.0:1789760788.975640:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789760788.975664:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b765f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7658 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.975697:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b765f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7658 expref: 23 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.975708:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330a7459c00/0x838c7b3c022b765f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7658 expref: 23 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789760788.975717:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330a7459c00, rc 0) 00000100:00100000:0.0:1789760788.975790:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083299712:12345-0@lo:101: Request processed in 3810us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760788.975799:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789760788.976681:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299712:0@lo:101: 00010000:00010000:2.0:1789760788.976700:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b765f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760788.976711:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b765f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760788.976792:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299840:0@lo:501: 00000100:00100000:2.0:1789760788.976831:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.976864:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861a7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.976879:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299840 00000100:00100000:2.0:1789760788.976884:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299840 00000100:00100000:2.0:1789760788.976927:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789760788.976936:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083299840:12345-0@lo:501: 00000100:00100000:2.0:1789760788.977165:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085232050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083299840:12345-0@lo:501: Request processed in 229us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.977173:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789760788.977224:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299840:0@lo:501: 00000100:00100000:2.0:1789760788.977252:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299968:0@lo:503: 00000100:00100000:2.0:1789760788.977289:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.977321:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789760788.977414:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083299968 00000100:00100000:1.0:1789760788.977419:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083299968 00000100:00100000:1.0:1789760788.977448:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789760788.977457:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083299968:12345-0@lo:503: 00000100:00100000:1.0:1789760788.977806:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085233c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083299968:12345-0@lo:503: Request processed in 351us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760788.977812:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789760788.979916:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083299968:0@lo:503: 00000100:00100000:2.0:1789760788.980110:0:9377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9377:1876700083300096:0@lo:502: 00000100:00100000:2.0:1789760788.980168:0:9377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760788.980220:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300096 00000100:00100000:2.0:1789760788.980225:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300096 00000100:00100000:2.0:1789760788.980260:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789760788.980269:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+23:9377:x1876700083300096:12345-0@lo:502: 00000100:00100000:2.0:1789760788.980543:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+23:9377:x1876700083300096:12345-0@lo:502: Request processed in 274us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760788.980551:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789760788.980598:0:9377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760788.980624:0:9377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9377:1876700083300096:0@lo:502: 00000020:01000000:2.0:1789760788.980786:0:9377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789760788.980794:0:9377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789760788.980801:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760788.980803:0:9377:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789760788.980808:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789760788.980811:0:9377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.153@tcp to nid 0x20000c0a8cb99 (192.168.203.153@tcp) 00000020:01000000:2.0:1789760788.980832:0:9377:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789760788.980835:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789760788.980849:0:9377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9330bf1d4d28) 00000020:00000080:2.0:1789760788.980893:0:9377:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789760788.980995:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789760788.981284:0:9377:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789760788.981290:0:9377:0:(osd_handler.c:1573:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789760788.981316:0:9377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x838c7b3c022b766d 00010000:00080000:2.0:1789760788.986313:0:9377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff932f853d4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.153@tcp at head 00000004:00080000:3.0:1789760788.987712:0:7235:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:2.0:1789760788.992427:0:9377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789760788.993856:0:9377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789760788.993873:0:9377:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789760788.994623:0:9377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760788.994797:0:9377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789760788.994839:0:9377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789760788.994885:0:9377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789760788.995560:0:9380:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789760788.995565:0:9380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789760789.002175:0:9377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789760789.002208:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789760789.002244:0:9377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789760789.002271:0:9377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b7674 00000100:00080000:1.0:1789760789.002281:0:9377:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789760789.002287:0:9377:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff932f853d4800 using connection 192.168.203.153@tcp/0@lo 00000100:00100000:1.0:1789760789.002321:0:9377:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93309ea4d880 x1876700083300224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789760789.002340:0:9377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789760789.002510:0:9377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789760789.002515:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760789.002516:0:9377:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789760789.002519:0:9377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789760789.002523:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789760789.002525:0:9377:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789760789.002528:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789760789.002530:0:9377:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789760789.002570:0:9377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330a0845c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9377:1876700083300352:0@lo:502: 00000100:00100000:1.0:1789760789.002660:0:9377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760789.002697:0:9377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330852db000 going to sleep for 11 seconds 00000100:00100000:0.0:1789760789.003291:0:3427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083300224:0@lo:8: 00000100:00100000:0.0:1789760789.003334:0:3427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760789.003672:0:8335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300224 00000100:00100000:1.0:1789760789.003679:0:8335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300224 00000100:00100000:1.0:1789760789.003718:0:8335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789760789.003726:0:8335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3427:x1876700083300224:12345-0@lo:8: 00010000:00080000:1.0:1789760789.003753:0:8335:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1789760789.003776:0:8335:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x838c7b3c022b767b 00002000:00100000:1.0:1789760789.003791:0:8335:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff932f86421000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789760789.003795:0:8335:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789760789.003798:0:8335:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789760789.003886:0:8335:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789760789.003909:0:8335:0:(import.c:65:import_set_state_nolock()) ffff932f86425800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760789.003958:0:8335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3427:x1876700083300224:12345-0@lo:8: Request processed in 232us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760789.003965:0:8335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789760789.004133:0:3427:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93309ea4d880 x1876700083300224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789760799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.004144:0:3427:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789760789.004151:0:3427:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789760789.004158:0:3427:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789760789.004163:0:3427:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789760789.004165:0:3427:0:(import.c:65:import_set_state_nolock()) ffff932f853d4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789760789.004202:0:3427:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789760789.004208:0:3427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3427:1876700083300224:0@lo:8: 00000004:00080000:0.0:1789760789.004287:0:9380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789760789.005328:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300352 00000100:00100000:2.0:1789760789.005347:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300352 00000100:00100000:2.0:1789760789.006057:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789760789.006070:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+23:9377:x1876700083300352:12345-0@lo:502: 00000100:00100000:2.0:1789760789.006978:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:751d7670-4ea9-4485-a191-8db5c056760e+23:9377:x1876700083300352:12345-0@lo:502: Request processed in 908us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.006988:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789760789.007088:0:9377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330a0845c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:751d7670-4ea9-4485-a191-8db5c056760e:9377:1876700083300352:0@lo:502: 00000020:01000000:2.0:1789760789.007248:0:9377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789760789.007256:0:9377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789760789.007258:0:9377:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789760789.007264:0:9377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789760789.007666:0:6427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789760789.007757:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789760789.007766:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b765f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.007778:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330a7458000/0x838c7b3c022b7658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b765f expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789760789.007788:0:6427:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789760789.007849:0:6427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff93309ea30000 from 1 10000000:01000000:2.0:1789760789.007853:0:6427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789760789.007884:0:6427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.007893:0:6427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.007903:0:6427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.007921:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083300480:0@lo:101: 00000100:00100000:2.0:1789760789.007964:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760789.008002:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760789.008018:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300480 00000100:00100000:2.0:1789760789.008023:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300480 00000100:00100000:2.0:1789760789.008058:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789760789.008067:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+23:6427:x1876700083300480:12345-0@lo:101: 00010000:00010000:2.0:1789760789.008514:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760789.008530:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9330814f8a00/0x838c7b3c022b7689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x838c7b3c022b7682 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.008554:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9330814f8a00/0x838c7b3c022b7689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x838c7b3c022b7682 expref: 24 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.008566:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9330814f8a00/0x838c7b3c022b7689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x838c7b3c022b7682 expref: 24 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.008575:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9330814f8a00, rc 0) 00000100:00100000:2.0:1789760789.008636:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+24:6427:x1876700083300480:12345-0@lo:101: Request processed in 571us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.008650:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789760789.008708:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083300480:0@lo:101: 00010000:00010000:2.0:1789760789.008721:0:6427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7689 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.008730:0:6427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x838c7b3c022b7689 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789760789.008776:0:6427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083300608:0@lo:501: 00000100:00100000:2.0:1789760789.009536:0:6427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760789.011000:0:6427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330861a73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789760789.011028:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300608 00000100:00100000:2.0:1789760789.011035:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300608 00000100:00100000:2.0:1789760789.011078:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789760789.011087:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+24:6427:x1876700083300608:12345-0@lo:501: 00000004:00080000:0.0:1789760789.012349:0:9380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176237166401ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789760789.012941:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+24:6427:x1876700083300608:12345-0@lo:501: Request processed in 1852us (3404us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789760789.012953:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789760789.013118:0:6427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:751d7670-4ea9-4485-a191-8db5c056760e:6427:1876700083300608:0@lo:501: 10000000:01000000:2.0:1789760789.013156:0:6427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789760789.013255:0:6427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7689 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760789.013265:0:6427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff9330814f9000/0x838c7b3c022b7682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x838c7b3c022b7689 expref: -99 pid: 6427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:0.0:1789760789.013324:0:6436:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789760789.024522:0:6436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8084:x1876700083298688:12345-0@lo:700: Request processed in 75747us (80596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760789.024542:0:6436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760789.024596:0:8084:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1500 x1876700083298688/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789760804 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.024623:0:8084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8084:1876700083298688:0@lo:700: 40000000:02000000:0.0:1789760789.024637:0:8084:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000004:00080000:0.0:1789760789.067805:0:9381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760789.067834:0:9381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083300864:0@lo:7: 00000100:00100000:0.0:1789760789.067897:0:9381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760789.067925:0:9381:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a81600 going to sleep for 11 seconds 00000004:00080000:0.0:1789760789.067942:0:6451:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789760789.067975:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300864 00000100:00100000:0.0:1789760789.067982:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300864 00000100:00100000:0.0:1789760789.068038:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760789.068047:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9381:x1876700083300864:12345-0@lo:7: 00000100:00100000:3.0:1789760789.069855:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789760789.069880:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083300736:0@lo:13: 00000100:00100000:3.0:1789760789.069955:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789760789.070004:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760789.070022:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300736 00000100:00100000:3.0:1789760789.070029:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300736 00000100:00100000:3.0:1789760789.070078:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789760789.070088:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3430:x1876700083300736:12345-0@lo:13: 00002000:00000024:3.0:1789760789.070118:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789760789.070170:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3430:x1876700083300736:12345-0@lo:13: Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760789.070208:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789760789.070260:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1500 x1876700083300736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.070281:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083300736:0@lo:13: 00002000:00080000:0.0:1789760789.077201:0:8077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789760789.077209:0:8077:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789760789.077297:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9381:x1876700083300864:12345-0@lo:7: Request processed in 9247us (9395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760789.077308:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789760789.077367:0:9381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1880 x1876700083300864/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.077394:0:9381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083300864:0@lo:7: 00000004:00080000:0.0:1789760789.077408:0:9381:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789760789.077442:0:9381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083300992:0@lo:5: 00000100:00100000:0.0:1789760789.077473:0:9381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760789.077506:0:9381:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a81600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760789.077524:0:8335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083300992 00000100:00100000:0.0:1789760789.077529:0:8335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083300992 00000100:00100000:0.0:1789760789.077564:0:8335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789760789.077572:0:8335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9381:x1876700083300992:12345-0@lo:5: 00002000:00080000:0.0:1789760789.077594:0:8335:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789760789.077598:0:8335:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789760789.077902:0:8335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:9381:x1876700083300992:12345-0@lo:5: Request processed in 329us (427us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789760789.077910:0:8335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789760789.077956:0:9381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1880 x1876700083300992/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.077967:0:9381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083300992:0@lo:5: 00000004:00080000:0.0:1789760789.077975:0:9381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789760789.077999:0:9381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083301120:0@lo:700: 00000100:00100000:0.0:1789760789.078022:0:9381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760789.078036:0:9381:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a81600 going to sleep for 11 seconds 00000100:00100000:0.0:1789760789.078048:0:8083:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1789760789.078054:0:8083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:2.0:1789760789.081380:0:8083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301120 00000100:00100000:2.0:1789760789.081393:0:8083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301120 00000100:00100000:2.0:1789760789.081501:0:9392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789760789.081511:0:9392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:9381:x1876700083301120:12345-0@lo:700: 00000001:00100000:3.0:1789760789.087763:0:9047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789760789.087782:0:9047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789760789.088085:0:8084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083298560:12345-0@lo:700: Request processed in 144217us (144307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760789.088096:0:8084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789760789.088238:0:9370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed2d80 x1876700083298560/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760804 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.088344:0:9370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083298560:0@lo:700: 00000004:00080000:0.0:1789760789.137084:0:9370:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789760789.137284:0:9370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301376:0@lo:7: 00000100:00100000:0.0:1789760789.137351:0:9370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760789.137410:0:9370:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a81f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789760789.137425:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760789.137440:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083301248:0@lo:13: 00000100:00100000:0.0:1789760789.137469:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760789.137722:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301248 00000100:00100000:3.0:1789760789.137732:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301248 00000100:00100000:3.0:1789760789.137779:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789760789.137790:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083301248:12345-0@lo:13: 00002000:00000024:3.0:1789760789.137812:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789760789.137860:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083301248:12345-0@lo:13: Request processed in 72us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760789.137868:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789760789.137885:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed2d80 x1876700083301248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.137905:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083301248:0@lo:13: 00000100:00100000:2.0:1789760789.139501:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301376 00000100:00100000:2.0:1789760789.139509:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301376 00000100:00100000:2.0:1789760789.139543:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760789.139550:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083301376:12345-0@lo:7: 00002000:00080000:2.0:1789760789.148450:0:8074:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789760789.148459:0:8074:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789760789.148560:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083301376:12345-0@lo:7: Request processed in 9007us (11205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.148573:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789760789.148684:0:9370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed0a80 x1876700083301376/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.148701:0:9370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301376:0@lo:7: 00000004:00080000:3.0:1789760789.148716:0:9370:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789760789.148753:0:9370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301504:0@lo:5: 00000100:00100000:3.0:1789760789.148790:0:9370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760789.148818:0:9370:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789760789.148913:0:8074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301504 00000100:00100000:2.0:1789760789.148920:0:8074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301504 00000100:00100000:2.0:1789760789.148965:0:8074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789760789.148974:0:8074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083301504:12345-0@lo:5: 00002000:00080000:2.0:1789760789.149002:0:8074:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789760789.149042:0:8074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083301504:12345-0@lo:5: Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.149049:0:8074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789760789.149111:0:9370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b8a80 x1876700083301504/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.149122:0:9370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301504:0@lo:5: 00000004:00080000:3.0:1789760789.149132:0:9370:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789760789.149163:0:9370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301632:0@lo:5: 00000100:00100000:3.0:1789760789.149237:0:9370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760789.149253:0:9370:0:(client.c:2715:ptlrpc_set_wait()) set ffff933090d3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760789.149267:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301632 00000100:00100000:3.0:1789760789.149271:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301632 00000100:00100000:3.0:1789760789.149307:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789760789.149316:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9370:x1876700083301632:12345-0@lo:5: 00002000:00080000:3.0:1789760789.149345:0:8077:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789760789.159211:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9370:x1876700083301632:12345-0@lo:5: Request processed in 9891us (9967us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789760789.159224:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789760789.159326:0:9370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b8a80 x1876700083301632/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760789.159343:0:9370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9370:1876700083301632:0@lo:5: 00000004:00080000:0.0:1789760789.159358:0:9370:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789760789.159404:0:9370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9370:1876700083301760:0@lo:900: 00000100:00100000:0.0:1789760789.159442:0:9370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760789.159500:0:9370:0:(client.c:2715:ptlrpc_set_wait()) set ffff932f86a81c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789760789.159536:0:6440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301760 00000100:00100000:3.0:1789760789.159542:0:6440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301760 00000100:00100000:3.0:1789760789.159623:0:6440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789760789.159631:0:6440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9370:x1876700083301760:12345-0@lo:900: 00000100:00100000:3.0:1789760789.159692:0:6440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9370:x1876700083301760:12345-0@lo:900: Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760789.159699:0:6440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789760789.159760:0:9370:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed2d80 x1876700083301760/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.159770:0:9370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9370:1876700083301760:0@lo:900: 00000001:00080000:3.0:1789760789.164414:0:9047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789760789.164498:0:9392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9381:x1876700083301120:12345-0@lo:700: Request processed in 82984us (86470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760789.164511:0:9392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789760789.166385:0:9381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed0000 x1876700083301120/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.166404:0:9381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083301120:0@lo:700: 00000001:02000400:0.0:1789760789.175347:0:9401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg353-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:02000040:3.0:1789760789.202977:0:9381:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1789760789.209541:0:9381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083301888:0@lo:5: 00000100:00100000:2.0:1789760789.209619:0:9381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760789.209680:0:8335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083301888 00000100:00100000:2.0:1789760789.209690:0:8335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083301888 00000100:00100000:2.0:1789760789.209743:0:8335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789760789.209751:0:8335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9381:x1876700083301888:12345-0@lo:5: 00000100:00100000:0.0:1789760789.210239:0:9381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9330b40d66c0 going to sleep for 11 seconds 00002000:00080000:2.0:1789760789.218337:0:8335:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789760789.218357:0:8335:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789760789.223408:0:8335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9381:x1876700083301888:12345-0@lo:5: Request processed in 13651us (13783us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789760789.223421:0:8335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789760789.223481:0:9381:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff933087c96300 x1876700083301888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760805 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.223495:0:9381:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789760789.223513:0:9381:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff933087c96300 x1876700083301888/t4294967299(4294967299) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789760805 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760789.223524:0:9381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c96300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9381:1876700083301888:0@lo:5: 00000004:00080000:3.0:1789760789.223537:0:9381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:0.0:1789760789.389313:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083302016:0@lo:41: 00000100:00100000:0.0:1789760789.389383:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760789.389621:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302016 00000100:00100000:3.0:1789760789.389631:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302016 00000100:00100000:3.0:1789760789.389699:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789760789.389709:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083302016:12345-0@lo:41: 00000004:00000024:3.0:1789760789.389750:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760789.389813:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083302016:12345-0@lo:41: Request processed in 103us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760789.389832:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789760789.390200:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083302016:0@lo:41: 00010000:00010000:3.0:1789760789.830289:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760790.854446:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760791.878309:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760792.455465:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789760792.455506:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083302144:0@lo:41: 00000100:00100000:1.0:1789760792.455609:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760792.455817:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302144 00000100:00100000:0.0:1789760792.455833:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302144 00000100:00100000:0.0:1789760792.455882:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789760792.455892:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083302144:12345-0@lo:41: 00000004:00000024:0.0:1789760792.455928:0:6434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760792.455980:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083302144:12345-0@lo:41: Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760792.455987:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789760792.456063:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083302144:0@lo:41: 00010000:00010000:3.0:1789760792.902369:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789760793.475729:0:9047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1789760793.475756:0:9047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789760793.873144:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760793.873221:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069625984 00000100:00100000:2.0:1789760793.873231:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069625984 00000100:00100000:2.0:1789760793.873275:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:2.0:1789760793.873283:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1876700069625984:12345-192.168.203.53@tcp:250: 00010000:00080000:2.0:1789760793.873308:0:6424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 198ebcf5-fdc7-4639-9840-1db66dbf286b@192.168.203.53@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1789760793.873335:0:6424:0:(genops.c:1385:class_connect()) connect: client 198ebcf5-fdc7-4639-9840-1db66dbf286b, cookie 0x838c7b3c022b7690 00000100:00080000:2.0:1789760793.873464:0:6424:0:(import.c:65:import_set_state_nolock()) ffff932f853d6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760793.873652:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+5:2408:x1876700069625984:12345-192.168.203.53@tcp:250: Request processed in 249us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.873661:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 176 00000100:00100000:0.0:1789760793.878229:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760793.878861:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626112 00000100:00100000:3.0:1789760793.878872:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626112 00000100:00100000:3.0:1789760793.878931:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:3.0:1789760793.878940:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+5:6372:x1876700069626112:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1789760793.878954:0:6422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760793.878969:0:6422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080031200/0x838c7b3c022b7697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x86509cd03eee99cb expref: -99 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.878995:0:6422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080031200/0x838c7b3c022b7697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee99cb expref: 6 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.879006:0:6422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080031200/0x838c7b3c022b7697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee99cb expref: 6 pid: 6422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.879015:0:6422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080031200, rc 0) 00000100:00100000:3.0:1789760793.879061:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+6:6372:x1876700069626112:12345-192.168.203.53@tcp:101: Request processed in 122us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.879067:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 177 00000100:00100000:0.0:1789760793.883236:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760793.883304:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626240 00000100:00100000:1.0:1789760793.883314:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626240 00000100:00100000:1.0:1789760793.883383:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:1.0:1789760793.883394:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+6:6372:x1876700069626240:12345-192.168.203.53@tcp:501: 00000100:00100000:1.0:1789760793.883792:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+6:6372:x1876700069626240:12345-192.168.203.53@tcp:501: Request processed in 398us (564us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789760793.883800:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 178 00000100:00100000:0.0:1789760793.885382:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760793.885449:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626368 00000100:00100000:2.0:1789760793.885457:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626368 00000100:00100000:2.0:1789760793.885543:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 179 00000100:00100000:2.0:1789760793.885552:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+6:6372:x1876700069626368:12345-192.168.203.53@tcp:101: 00010000:00010000:2.0:1789760793.885564:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760793.885590:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93308167f000/0x838c7b3c022b769e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x86509cd03eee99d2 expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.885615:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93308167f000/0x838c7b3c022b769e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee99d2 expref: 7 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.885636:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93308167f000/0x838c7b3c022b769e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee99d2 expref: 7 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.885645:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93308167f000, rc 0) 00000100:00100000:2.0:1789760793.885690:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+7:6372:x1876700069626368:12345-192.168.203.53@tcp:101: Request processed in 138us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.885696:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 179 00000100:00100000:3.0:1789760793.892985:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789760793.893130:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626496 00000100:00100000:0.0:1789760793.893139:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626496 00000100:00100000:0.0:1789760793.893215:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 180 00000100:00100000:0.0:1789760793.893225:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+7:6372:x1876700069626496:12345-192.168.203.53@tcp:501: 00000100:00100000:0.0:1789760793.893472:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6372:x1876700069626496:12345-192.168.203.53@tcp:501: Request processed in 246us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.893480:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 180 00000100:00100000:0.0:1789760793.896119:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760793.896215:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626624 00000100:00100000:2.0:1789760793.896224:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626624 00000100:00100000:2.0:1789760793.896267:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 181 00000100:00100000:2.0:1789760793.896277:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6372:x1876700069626624:12345-192.168.203.53@tcp:503: 00000100:00100000:2.0:1789760793.896756:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6372:x1876700069626624:12345-192.168.203.53@tcp:503: Request processed in 479us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.896765:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 181 00000100:00100000:0.0:1789760793.899666:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760793.899741:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626752 00000100:00100000:3.0:1789760793.899750:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626752 00000100:00100000:3.0:1789760793.900642:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 182 00000100:00100000:3.0:1789760793.900655:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6390:x1876700069626752:12345-192.168.203.53@tcp:502: 00000100:00100000:3.0:1789760793.900980:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6390:x1876700069626752:12345-192.168.203.53@tcp:502: Request processed in 326us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.900988:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 182 00010000:00010000:3.0:1789760793.929730:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789760793.944974:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760793.945082:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069626880 00000100:00100000:3.0:1789760793.945092:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069626880 00000100:00100000:3.0:1789760793.945142:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 183 00000100:00100000:3.0:1789760793.945152:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6390:x1876700069626880:12345-192.168.203.53@tcp:502: 00000100:00100000:3.0:1789760793.945415:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6390:x1876700069626880:12345-192.168.203.53@tcp:502: Request processed in 263us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.945424:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 183 00000100:00100000:3.0:1789760793.954855:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760793.954891:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627008 00000100:00100000:3.0:1789760793.954906:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627008 00000100:00100000:3.0:1789760793.954951:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:3.0:1789760793.954962:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+8:6372:x1876700069627008:12345-192.168.203.53@tcp:101: 00010000:00010000:3.0:1789760793.954978:0:6424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789760793.954995:0:6424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff933080030e00/0x838c7b3c022b76a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x86509cd03eee9a03 expref: -99 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.955023:0:6424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff933080030e00/0x838c7b3c022b76a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a03 expref: 9 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.955033:0:6424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff933080030e00/0x838c7b3c022b76a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a03 expref: 9 pid: 6424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789760793.955055:0:6424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933080030e00, rc 0) 00000100:00100000:3.0:1789760793.955101:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+9:6372:x1876700069627008:12345-192.168.203.53@tcp:101: Request processed in 140us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.955108:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 184 00000100:00100000:1.0:1789760793.964248:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760793.964284:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627136 00000100:00100000:1.0:1789760793.964293:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627136 00000100:00100000:1.0:1789760793.964338:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00100000:1.0:1789760793.964349:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93308520a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+9:6372:x1876700069627136:12345-192.168.203.53@tcp:256: 20000000:01000000:1.0:1789760793.964371:0:6422:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789760793.964387:0:6422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789760793.964391:0:6422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789760793.964395:0:6422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789760793.964398:0:6422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789760793.964401:0:6422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789760793.967119:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93308520a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+9:6372:x1876700069627136:12345-192.168.203.53@tcp:256: Request processed in 2760us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.967134:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 185 00000100:00100000:1.0:1789760793.973556:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760793.973788:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627264 00000100:00100000:2.0:1789760793.973798:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627264 00000100:00100000:2.0:1789760793.973850:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 186 00000100:00100000:2.0:1789760793.973862:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+9:6372:x1876700069627264:12345-192.168.203.53@tcp:101: 00010000:00010000:2.0:1789760793.973883:0:6425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760793.973911:0:6425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93308167ee00/0x838c7b3c022b76ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x86509cd03eee9a0a expref: -99 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.973937:0:6425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93308167ee00/0x838c7b3c022b76ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a0a expref: 10 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.973950:0:6425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93308167ee00/0x838c7b3c022b76ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a0a expref: 10 pid: 6425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760793.973972:0:6425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93308167ee00, rc 0) 00000100:00100000:2.0:1789760793.974025:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085208850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6372:x1876700069627264:12345-192.168.203.53@tcp:101: Request processed in 165us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.974032:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 186 00000100:00100000:1.0:1789760793.976698:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789760793.976774:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627392 00000100:00100000:0.0:1789760793.976784:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627392 00000100:00100000:0.0:1789760793.976835:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 187 00000100:00100000:0.0:1789760793.976845:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6372:x1876700069627392:12345-192.168.203.53@tcp:501: 00000100:00100000:0.0:1789760793.977166:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085209450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6372:x1876700069627392:12345-192.168.203.53@tcp:501: Request processed in 321us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.977173:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 187 00000100:00100000:0.0:1789760793.990261:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760793.990361:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627520 00000100:00100000:3.0:1789760793.990370:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627520 00000100:00100000:3.0:1789760793.990415:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 188 00000100:00100000:3.0:1789760793.990424:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6372:x1876700069627520:12345-192.168.203.53@tcp:503: 00000100:00100000:3.0:1789760793.990756:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6372:x1876700069627520:12345-192.168.203.53@tcp:503: Request processed in 331us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760793.990764:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 188 00000100:00100000:0.0:1789760793.990884:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789760793.990909:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083302272:0@lo:13: 00000100:00100000:0.0:1789760793.990948:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760793.991003:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302272 00000100:00100000:0.0:1789760793.991007:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302272 00000100:00100000:0.0:1789760793.991042:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789760793.991050:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083302272:12345-0@lo:13: 00002000:00000024:0.0:1789760793.991073:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789760793.991110:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083302272:12345-0@lo:13: Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760793.991116:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789760793.991138:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789760793.991166:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1180 x1876700083302272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789760793.991206:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083302272:0@lo:13: 00000100:00100000:1.0:1789760793.991625:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083302400:0@lo:13: 00000100:00100000:1.0:1789760793.991660:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760793.992034:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302400 00000100:00100000:2.0:1789760793.992041:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302400 00000100:00100000:2.0:1789760793.992088:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789760793.992096:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083302400:12345-0@lo:13: 00002000:00000024:2.0:1789760793.992113:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760793.992153:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083302400:12345-0@lo:13: Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760793.992159:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789760793.993346:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff933087c94e00 x1876700083302400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760793.993372:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083302400:0@lo:13: 00000100:00080000:1.0:1789760793.993405:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789760794.012330:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760794.012548:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627648 00000100:00100000:2.0:1789760794.012558:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627648 00000100:00100000:2.0:1789760794.012621:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00100000:2.0:1789760794.012632:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6395:x1876700069627648:12345-192.168.203.53@tcp:502: 00000100:00100000:2.0:1789760794.012872:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6395:x1876700069627648:12345-192.168.203.53@tcp:502: Request processed in 241us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760794.012880:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 189 00000100:00100000:1.0:1789760794.016757:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789760794.017420:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627776 00000100:00100000:0.0:1789760794.017430:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627776 00000100:00100000:0.0:1789760794.017480:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:0.0:1789760794.017490:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6395:x1876700069627776:12345-192.168.203.53@tcp:502: 00000100:00100000:0.0:1789760794.017723:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:6395:x1876700069627776:12345-192.168.203.53@tcp:502: Request processed in 233us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760794.017731:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 190 00000100:00100000:1.0:1789760794.034415:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760794.034475:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760794.034559:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069627904 00000100:00100000:3.0:1789760794.034578:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069627904 00000100:00100000:3.0:1789760794.034620:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628160 00000100:00100000:3.0:1789760794.034623:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628160 00000100:00100000:3.0:1789760794.034645:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:3.0:1789760794.034652:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1876700069627904:12345-192.168.203.53@tcp:38: 00010000:00080000:3.0:1789760794.034679:0:6430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 71e736da-ab6f-4a34-ae86-8fa305cd8101@192.168.203.53@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1789760794.034730:0:6430:0:(genops.c:1385:class_connect()) connect: client 71e736da-ab6f-4a34-ae86-8fa305cd8101, cookie 0x838c7b3c022b76b3 00000004:00100000:3.0:1789760794.034756:0:6430:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789760794.034975:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00100000:1.0:1789760794.034981:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2408:x1876700069628160:12345-192.168.203.53@tcp:38: 00010000:00080000:1.0:1789760794.034996:0:6429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 71e736da-ab6f-4a34-ae86-8fa305cd8101@192.168.203.53@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1789760794.035024:0:6429:0:(genops.c:1385:class_connect()) connect: client 71e736da-ab6f-4a34-ae86-8fa305cd8101, cookie 0x838c7b3c022b76ba 00000004:00100000:1.0:1789760794.035038:0:6429:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789760794.035335:0:6429:0:(import.c:65:import_set_state_nolock()) ffff932f86421800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789760794.035391:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:2408:x1876700069628160:12345-192.168.203.53@tcp:38: Request processed in 408us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760794.035399:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 8 00000100:00080000:3.0:1789760794.035858:0:6430:0:(import.c:65:import_set_state_nolock()) ffff9330b5ebf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789760794.036116:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:2408:x1876700069627904:12345-192.168.203.53@tcp:38: Request processed in 1461us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.036123:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 7 00000100:00100000:3.0:1789760794.502813:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789760794.502853:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083302528:0@lo:41: 00000100:00100000:3.0:1789760794.502918:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.502978:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302528 00000100:00100000:3.0:1789760794.502984:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302528 00000100:00100000:3.0:1789760794.503021:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789760794.503029:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b43bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083302528:12345-0@lo:41: 00000004:00000024:3.0:1789760794.503062:0:7341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760794.503098:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b43bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3428:x1876700083302528:12345-0@lo:41: Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.503105:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789760794.503413:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3431:1876700083302784:0@lo:400: 00000100:00100000:3.0:1789760794.503440:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503454:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3431:1876700083303296:0@lo:400: 00000100:00100000:3.0:1789760794.503469:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503481:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083303808:0@lo:400: 00000100:00100000:3.0:1789760794.503501:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503522:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789760794.503527:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083302656:0@lo:400: 00000100:00100000:3.0:1789760794.503553:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503581:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3431:1876700083303168:0@lo:400: 00000100:00100000:3.0:1789760794.503603:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503621:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083303680:0@lo:400: 00000100:00100000:3.0:1789760794.503640:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.503663:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303808 00000100:00100000:3.0:1789760794.503667:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303808 00000100:00100000:3.0:1789760794.503699:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303680 00000100:00100000:3.0:1789760794.503708:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303680 00000100:00100000:3.0:1789760794.503732:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760794.503739:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083303808:12345-0@lo:400: 00000100:00100000:3.0:1789760794.503776:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3431:x1876700083303808:12345-0@lo:400: Request processed in 38us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.503783:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789760794.503794:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789760794.503799:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083303680:12345-0@lo:400: 00000100:00100000:3.0:1789760794.503826:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083303680:12345-0@lo:400: Request processed in 27us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.503832:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789760794.503845:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760794.503856:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302784 00000100:00100000:3.0:1789760794.503859:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302784 00000100:00100000:3.0:1789760794.503878:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303296 00000100:00100000:3.0:1789760794.503887:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303296 00000100:00100000:3.0:1789760794.503902:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303168 00000100:00100000:3.0:1789760794.503904:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303168 00000100:00100000:3.0:1789760794.503916:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760794.503922:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3431:x1876700083302784:12345-0@lo:400: 00000100:00100000:3.0:1789760794.503951:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3431:x1876700083302784:12345-0@lo:400: Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.503957:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789760794.503968:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760794.503973:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3431:x1876700083303296:12345-0@lo:400: 00000100:00100000:3.0:1789760794.503996:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3431:x1876700083303296:12345-0@lo:400: Request processed in 23us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.504000:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789760794.504020:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789760794.504025:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3431:x1876700083303168:12345-0@lo:400: 00000100:00100000:3.0:1789760794.504051:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3431:x1876700083303168:12345-0@lo:400: Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.504056:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789760794.504070:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789760794.504072:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760794.504082:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083302912:0@lo:400: 00000100:00100000:3.0:1789760794.504153:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.504170:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3428:1876700083303424:0@lo:400: 00000100:00100000:3.0:1789760794.504221:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.504258:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3428:1876700083302528:0@lo:41: 00000100:00100000:3.0:1789760794.504277:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789760794.504284:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083303040:0@lo:400: 00000100:00100000:3.0:1789760794.504306:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.504318:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3428:1876700083303552:0@lo:400: 00000100:00100000:3.0:1789760794.504355:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760794.504378:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302912 00000100:00100000:3.0:1789760794.504381:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302912 00000100:00100000:3.0:1789760794.504408:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760794.504414:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083302912:12345-0@lo:400: 00000100:00100000:3.0:1789760794.504452:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3428:x1876700083302912:12345-0@lo:400: Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.504457:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789760794.504871:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303424 00000100:00100000:3.0:1789760794.504875:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303424 00000100:00100000:3.0:1789760794.504899:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303040 00000100:00100000:3.0:1789760794.504906:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303040 00000100:00100000:3.0:1789760794.504917:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303552 00000100:00100000:3.0:1789760794.504919:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303552 00000100:00100000:3.0:1789760794.504931:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760794.504936:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3428:x1876700083303424:12345-0@lo:400: 00000100:00100000:3.0:1789760794.504963:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3428:x1876700083303424:12345-0@lo:400: Request processed in 27us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.504968:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789760794.504977:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760794.504982:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083303040:12345-0@lo:400: 00000100:00100000:3.0:1789760794.505001:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3428:x1876700083303040:12345-0@lo:400: Request processed in 20us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.505006:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789760794.505015:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789760794.505019:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3428:x1876700083303552:12345-0@lo:400: 00000100:00100000:3.0:1789760794.505038:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3428:x1876700083303552:12345-0@lo:400: Request processed in 19us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.505043:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789760794.505056:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789760794.505058:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789760794.505079:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd504700 x1876700083303168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505090:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3431:1876700083303168:0@lo:400: 00010000:00080000:3.0:1789760794.505100:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd505880 x1876700083303680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505108:0:3431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789760794.505118:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083303680:0@lo:400: 00010000:00080000:3.0:1789760794.505136:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b43b8e00 x1876700083302784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505206:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3431:1876700083302784:0@lo:400: 00010000:00080000:3.0:1789760794.505361:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd506d80 x1876700083303296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505371:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3431:1876700083303296:0@lo:400: 00010000:00080000:3.0:1789760794.505382:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b5bedf80 x1876700083303808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505390:0:3431:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789760794.505400:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b5bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3431:1876700083303808:0@lo:400: 00010000:00080000:3.0:1789760794.505432:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd507480 x1876700083303040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505442:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3428:1876700083303040:0@lo:400: 00010000:00080000:3.0:1789760794.505453:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd506680 x1876700083303552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505461:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3428:1876700083303552:0@lo:400: 00000100:00100000:3.0:1789760794.505471:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330ba16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3428:1876700083302912:0@lo:400: 00010000:00080000:3.0:1789760794.505481:0:3428:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bd504000 x1876700083303424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.505490:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bd504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3428:1876700083303424:0@lo:400: 00000100:00100000:2.0:1789760794.505639:0:6425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083302656 00000100:00100000:2.0:1789760794.505644:0:6425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083302656 00000100:00100000:2.0:1789760794.505675:0:6425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760794.505683:0:6425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933085227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+24:3431:x1876700083302656:12345-0@lo:400: 00000100:00100000:2.0:1789760794.505727:0:6425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933085227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:751d7670-4ea9-4485-a191-8db5c056760e+24:3431:x1876700083302656:12345-0@lo:400: Request processed in 46us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760794.505744:0:6425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789760794.505787:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b43bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:751d7670-4ea9-4485-a191-8db5c056760e:3431:1876700083302656:0@lo:400: 00000100:00100000:0.0:1789760794.507359:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789760794.507389:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083303936:0@lo:13: 00000100:00100000:0.0:1789760794.507449:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760794.511407:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083303936 00000100:00100000:2.0:1789760794.511423:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083303936 00000100:00100000:2.0:1789760794.511476:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789760794.511486:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083303936:12345-0@lo:13: 00002000:00000024:2.0:1789760794.511532:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760794.511630:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083303936:12345-0@lo:13: Request processed in 145us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760794.511638:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789760794.514871:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083304064:0@lo:13: 00000100:00100000:3.0:1789760794.514942:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789760794.515005:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1180 x1876700083303936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.515029:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083303936:0@lo:13: 00000100:00100000:3.0:1789760794.515065:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304064 00000100:00100000:3.0:1789760794.515071:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304064 00000100:00100000:3.0:1789760794.515103:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789760794.515112:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083304064:12345-0@lo:13: 00002000:00000024:3.0:1789760794.515132:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760794.515175:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3429:x1876700083304064:12345-0@lo:13: Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760794.515199:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789760794.515362:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff933087c95180 x1876700083304064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760794.515376:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3429:1876700083304064:0@lo:13: 00000001:00100000:2.0:1789760794.552386:0:7235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 71e736da-ab6f-4a34-ae86-8fa305cd8101 00000001:00100000:3.0:1789760794.558624:0:6451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 71e736da-ab6f-4a34-ae86-8fa305cd8101 00010000:00010000:3.0:1789760794.950346:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789760795.043000:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.043038:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.043128:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760795.043228:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628416 00000100:00100000:3.0:1789760795.043238:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628416 00000100:00100000:3.0:1789760795.043305:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628288 00000100:00100000:3.0:1789760795.043309:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628288 00000100:00100000:3.0:1789760795.043323:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628032 00000100:00100000:3.0:1789760795.043325:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628032 00000100:00100000:3.0:1789760795.043338:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00100000:3.0:1789760795.043347:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6372:x1876700069628416:12345-192.168.203.53@tcp:41: 00000004:00000024:3.0:1789760795.043386:0:9043:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760795.043414:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:2.0:1789760795.043427:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:0:x1876700069628288:12345-192.168.203.53@tcp:41: 00000004:00000024:2.0:1789760795.043453:0:6431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760795.043489:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:0:x1876700069628288:12345-192.168.203.53@tcp:41: Request processed in 66us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.043496:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 10 00000100:00100000:2.0:1789760795.043516:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:2.0:1789760795.043524:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:0:x1876700069628032:12345-192.168.203.53@tcp:41: 00000100:00100000:3.0:1789760795.043534:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6372:x1876700069628416:12345-192.168.203.53@tcp:41: Request processed in 185us (540us total) trans 0 rc 0/0 00000004:00000024:2.0:1789760795.043536:0:6431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760795.043574:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:0:x1876700069628032:12345-192.168.203.53@tcp:41: Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.043581:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 11 00000100:00100000:3.0:1789760795.043781:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 9 00000100:00080000:1.0:1789760795.043937:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789760795.043942:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789760795.048015:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760795.048544:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628544 00000100:00100000:2.0:1789760795.048632:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628544 00000100:00100000:2.0:1789760795.048697:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:2.0:1789760795.048709:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069628544:12345-192.168.203.53@tcp:40: 00000100:00100000:2.0:1789760795.048916:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0847480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069628544:12345-192.168.203.53@tcp:40: Request processed in 208us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.048924:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 12 00000100:00100000:1.0:1789760795.052469:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.052622:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.052659:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.052743:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789760795.052776:0:6441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628928 00000100:00100000:0.0:1789760795.052785:0:6441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628928 00000100:00100000:0.0:1789760795.052847:0:6441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:0.0:1789760795.052858:0:6441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069628928:12345-192.168.203.53@tcp:900: 00000100:00100000:0.0:1789760795.052941:0:6441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069628928:12345-192.168.203.53@tcp:900: Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760795.052949:0:6441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 4 00000100:00100000:3.0:1789760795.053020:0:6424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629056 00000100:00100000:3.0:1789760795.053026:0:6424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629056 00000100:00100000:3.0:1789760795.053065:0:6424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 192 00000100:00100000:3.0:1789760795.053074:0:6424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:2411:x1876700069629056:12345-192.168.203.53@tcp:400: 00000100:00100000:3.0:1789760795.053131:0:6424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:198ebcf5-fdc7-4639-9840-1db66dbf286b+10:2411:x1876700069629056:12345-192.168.203.53@tcp:400: Request processed in 50us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760795.053138:0:6424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 192 00000100:00100000:1.0:1789760795.058873:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789760795.058945:0:6432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629184 00000100:00100000:1.0:1789760795.058965:0:6432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629184 00000100:00100000:1.0:1789760795.059011:0:6432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1789760795.059021:0:6432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069629184:12345-192.168.203.53@tcp:33: 00000100:00100000:2.0:1789760795.062314:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628672 00000100:00100000:2.0:1789760795.062328:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628672 00000100:00100000:2.0:1789760795.062375:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069628800 00000100:00100000:2.0:1789760795.062379:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069628800 00000100:00100000:2.0:1789760795.062404:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:2.0:1789760795.062412:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1876700069628672:12345-192.168.203.53@tcp:8: 00010000:00080000:2.0:1789760795.062443:0:8077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 71e736da-ab6f-4a34-ae86-8fa305cd8101@192.168.203.53@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789760795.062475:0:8077:0:(genops.c:1385:class_connect()) connect: client 71e736da-ab6f-4a34-ae86-8fa305cd8101, cookie 0x838c7b3c022b76c1 00002000:00100000:2.0:1789760795.062486:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 71e736da-ab6f-4a34-ae86-8fa305cd8101/ffff932f853d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760795.062496:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760795.063101:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789760795.063144:0:8077:0:(import.c:65:import_set_state_nolock()) ffff932f853d1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760795.063238:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:2408:x1876700069628672:12345-192.168.203.53@tcp:8: Request processed in 824us (10577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.063246:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 16 00000100:00100000:2.0:1789760795.063268:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 17 00000100:00100000:2.0:1789760795.063273:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1876700069628800:12345-192.168.203.53@tcp:8: 00010000:00080000:2.0:1789760795.063291:0:8077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 71e736da-ab6f-4a34-ae86-8fa305cd8101@192.168.203.53@tcp t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789760795.063308:0:8077:0:(genops.c:1385:class_connect()) connect: client 71e736da-ab6f-4a34-ae86-8fa305cd8101, cookie 0x838c7b3c022b76c8 00002000:00100000:2.0:1789760795.063326:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 71e736da-ab6f-4a34-ae86-8fa305cd8101/ffff932f853d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789760795.063333:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789760795.063573:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789760795.063590:0:8077:0:(import.c:65:import_set_state_nolock()) ffff932f853d1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789760795.063615:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:2408:x1876700069628800:12345-192.168.203.53@tcp:8: Request processed in 340us (10872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.063621:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 17 00000004:00080000:1.0:1789760795.093365:0:6432:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34281us 00000004:00200000:1.0:1789760795.109084:0:6432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789760795.109224:0:6432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6372:x1876700069629184:12345-192.168.203.53@tcp:33: Request processed in 50198us (50354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760795.109235:0:6432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 0 00000100:00100000:1.0:1789760795.278576:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789760795.279827:0:6430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629312 00000100:00100000:0.0:1789760795.279839:0:6430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629312 00000100:00100000:2.0:1789760795.280249:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 13 00000100:00100000:2.0:1789760795.280262:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6414:x1876700069629312:12345-192.168.203.53@tcp:101: 00010000:00010000:2.0:1789760795.280282:0:6430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789760795.280353:0:6430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fe00/0x838c7b3c022b76cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x86509cd03eee9a3b expref: -99 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280415:0:6430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fa00/0x838c7b3c022b76d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280429:0:6430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fa00/0x838c7b3c022b76d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280444:0:6430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fa00/0x838c7b3c022b76d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789760795.280477:0:6430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789760795.280481:0:6430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 2 00000004:00010000:2.0:1789760795.280495:0:6430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fa00/0x838c7b3c022b76d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280519:0:6430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fe00/0x838c7b3c022b76cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a3b expref: 7 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280568:0:6430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93308167fa00/0x838c7b3c022b76d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0x86509cd03eee9a3b expref: 6 pid: 6430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789760795.280578:0:6430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933086195b00) 00010000:00010000:2.0:1789760795.280581:0:6430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789760795.280584:0:6430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93308167fa00, rc 0) 00000100:00100000:2.0:1789760795.280846:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6414:x1876700069629312:12345-192.168.203.53@tcp:101: Request processed in 585us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760795.280854:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 13 00010000:00010000:3.0:1789760795.974516:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760796.998364:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760797.167339:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760797.167429:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629440 00000100:00100000:2.0:1789760797.167437:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629440 00000100:00100000:2.0:1789760797.167514:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1789760797.167524:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629440:12345-192.168.203.53@tcp:41: 00000004:00000024:2.0:1789760797.167575:0:6431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789760797.167648:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629440:12345-192.168.203.53@tcp:41: Request processed in 125us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.167655:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00080000:1.0:1789760797.167816:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760797.169311:0:3421:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760797.169377:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629568 00000100:00100000:3.0:1789760797.169386:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629568 00000100:00080000:1.0:1789760797.169467:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789760797.169474:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1789760797.169485:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6466:x1876700069629568:12345-192.168.203.53@tcp:41: 00000004:00000024:3.0:1789760797.169518:0:9043:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:3.0:1789760797.169585:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71e736da-ab6f-4a34-ae86-8fa305cd8101+5:6466:x1876700069629568:12345-192.168.203.53@tcp:41: Request processed in 102us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760797.169593:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1789760797.173514:0:3423:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789760797.173710:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629696 00000100:00100000:2.0:1789760797.173721:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629696 00000100:00100000:2.0:1789760797.173801:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00100000:2.0:1789760797.173812:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629696:12345-192.168.203.53@tcp:13: 00002000:00000024:2.0:1789760797.173854:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760797.173984:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629696:12345-192.168.203.53@tcp:13: Request processed in 172us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760797.173993:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 14 00000100:00080000:1.0:1789760797.174120:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789760797.176875:0:3422:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789760797.177135:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700069629824 00000100:00100000:3.0:1789760797.177144:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700069629824 00000100:00100000:3.0:1789760797.177243:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00100000:3.0:1789760797.177254:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff932f85ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629824:12345-192.168.203.53@tcp:13: 00002000:00000024:3.0:1789760797.177289:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760797.177346:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff932f85ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:71e736da-ab6f-4a34-ae86-8fa305cd8101+6:6466:x1876700069629824:12345-192.168.203.53@tcp:13: Request processed in 94us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760797.177366:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 15 00000100:00080000:1.0:1789760797.177866:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789760797.576207:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789760797.576232:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304192:0@lo:41: 00000100:00100000:3.0:1789760797.576301:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789760797.576348:0:6435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304192 00000100:00100000:0.0:1789760797.576357:0:6435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304192 00000100:00100000:0.0:1789760797.576415:0:6435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789760797.576424:0:6435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304192:12345-0@lo:41: 00000004:00000024:0.0:1789760797.576450:0:6435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789760797.576501:0:6435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304192:12345-0@lo:41: Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789760797.576510:0:6435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789760797.576531:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304192:0@lo:41: 00010000:00010000:3.0:1789760798.023286:0:7700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789760799.046407:0:6418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789760799.110597:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304320:0@lo:13: 00000100:00100000:3.0:1789760799.110675:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760799.110874:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304320 00000100:00100000:2.0:1789760799.110882:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304320 00000100:00100000:2.0:1789760799.110932:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789760799.110942:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304320:12345-0@lo:13: 00002000:00000024:2.0:1789760799.110976:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789760799.111035:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304320:12345-0@lo:13: Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.111041:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789760799.111116:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed0a80 x1876700083304320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760799.111135:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304320:0@lo:13: 00000100:00080000:1.0:1789760799.111412:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789760799.111496:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760799.111506:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083304448:0@lo:13: 00000100:00100000:3.0:1789760799.111547:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760799.111575:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304448 00000100:00100000:3.0:1789760799.111580:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304448 00000100:00100000:3.0:1789760799.111610:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789760799.111617:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083304448:12345-0@lo:13: 00002000:00000024:3.0:1789760799.111628:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789760799.111674:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083304448:12345-0@lo:13: Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760799.111680:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789760799.111694:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789760799.111711:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330b5bece00 x1876700083304448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789760799.111743:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083304448:0@lo:13: 00000001:00100000:3.0:1789760799.201968:0:9047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 71e736da-ab6f-4a34-ae86-8fa305cd8101 00000001:02000400:1.0:1789760799.396806:0:9705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789760799.622361:0:3431:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789760799.622387:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304704:0@lo:13: 00000100:00100000:3.0:1789760799.622388:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330b5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083304576:0@lo:41: 00000100:00100000:1.0:1789760799.622545:0:3430:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789760799.622557:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083304832:0@lo:13: 00000100:00100000:3.0:1789760799.622790:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760799.622843:0:3429:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789760799.622865:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083304960:0@lo:400: 00000100:00100000:2.0:1789760799.622866:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760799.622905:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760799.622913:0:8078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304704 00000100:00100000:2.0:1789760799.622921:0:8078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304704 00000100:00100000:3.0:1789760799.622968:0:6434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304576 00000100:00100000:3.0:1789760799.622973:0:6434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304576 00000100:00100000:2.0:1789760799.622979:0:8078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789760799.622991:0:8078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304704:12345-0@lo:13: 00000100:00100000:3.0:1789760799.623006:0:6434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789760799.623016:0:6434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330b5bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083304576:12345-0@lo:41: 00002000:00000024:2.0:1789760799.623023:0:8078:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000004:00000024:3.0:1789760799.623042:0:6434:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261909504 avail 2259812352 00000100:00100000:2.0:1789760799.623107:0:8078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3431:x1876700083304704:12345-0@lo:13: Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.623115:0:8078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789760799.623133:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789760799.623139:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789760799.623153:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304832 00000100:00100000:2.0:1789760799.623157:0:8079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304832 00000100:00100000:1.0:1789760799.623165:0:3428:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789760799.623175:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083305088:0@lo:400: 00000100:00100000:2.0:1789760799.623203:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789760799.623211:0:8079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083304832:12345-0@lo:13: 00002000:00000024:2.0:1789760799.623224:0:8079:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789760799.623246:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760799.623272:0:8079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3430:x1876700083304832:12345-0@lo:13: Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.623280:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789760799.623292:0:6429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305088 00000100:00100000:1.0:1789760799.623298:0:6429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305088 00000100:00080000:2.0:1789760799.623308:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789760799.623335:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760799.623343:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083305088:12345-0@lo:400: 00000100:00100000:1.0:1789760799.623385:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3428:x1876700083305088:12345-0@lo:400: Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760799.623392:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789760799.623436:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3428:1876700083305088:0@lo:400: 00010000:00080000:1.0:1789760799.623467:0:3430:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff932f85ed1180 x1876700083304832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760799.623487:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3430:1876700083304832:0@lo:13: 00000100:00100000:1.0:1789760799.623541:0:6422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083304960 00000100:00100000:1.0:1789760799.623545:0:6422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083304960 00010000:00080000:2.0:1789760799.623582:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff933087c94700 x1876700083304704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760799.623585:0:6422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789760799.623598:0:6422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93309e9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+24:3429:x1876700083304960:12345-0@lo:400: 00000100:00100000:2.0:1789760799.623602:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff933087c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3431:1876700083304704:0@lo:13: 00000100:00100000:0.0:1789760799.624591:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083305344:0@lo:400: 00000100:00100000:0.0:1789760799.624628:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760799.624713:0:6422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93309e9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:751d7670-4ea9-4485-a191-8db5c056760e+24:3429:x1876700083304960:12345-0@lo:400: Request processed in 1116us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760799.624721:0:6422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789760799.624758:0:3428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bf1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083305472:0@lo:400: 00000100:00100000:1.0:1789760799.624795:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083305216:0@lo:400: 00000100:00100000:1.0:1789760799.624821:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789760799.624842:0:3430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bf1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3430:1876700083305728:0@lo:400: 00000100:00100000:2.0:1789760799.624878:0:7341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305216 00000100:00100000:2.0:1789760799.624885:0:7341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305216 00000100:00100000:2.0:1789760799.624921:0:7341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789760799.624930:0:7341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083305216:12345-0@lo:400: 00000100:00100000:2.0:1789760799.624982:0:7341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3430:x1876700083305216:12345-0@lo:400: Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.624990:0:7341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789760799.625549:0:6434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330b5bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3429:x1876700083304576:12345-0@lo:41: Request processed in 2532us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760799.625557:0:6434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789760799.626886:0:3429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bf1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3429:1876700083305600:0@lo:400: 00000100:00100000:3.0:1789760799.627645:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305344 00000100:00100000:3.0:1789760799.627654:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305344 00000100:00100000:0.0:1789760799.627687:0:3428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760799.628060:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305472 00000100:00100000:3.0:1789760799.628066:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305472 00000100:00100000:2.0:1789760799.628114:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760799.628126:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bf1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083305344:12345-0@lo:400: 00000100:00100000:2.0:1789760799.628198:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bf1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3431:x1876700083305344:12345-0@lo:400: Request processed in 58us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.628206:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789760799.628223:0:6430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789760799.628230:0:6430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bf1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083305472:12345-0@lo:400: 00000100:00100000:2.0:1789760799.628261:0:6430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bf1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3428:x1876700083305472:12345-0@lo:400: Request processed in 31us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.628267:0:6430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789760799.628285:0:3430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760799.628343:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93309ea4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3430:1876700083305216:0@lo:400: 00000100:00100000:2.0:1789760799.628372:0:6431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305728 00000100:00100000:2.0:1789760799.628375:0:6431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305728 00000100:00100000:2.0:1789760799.628416:0:6431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789760799.628424:0:6431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933087c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3430:x1876700083305728:12345-0@lo:400: 00000100:00100000:0.0:1789760799.628462:0:3428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bf1f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3428:1876700083305472:0@lo:400: 00000100:00100000:2.0:1789760799.628468:0:6431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933087c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3430:x1876700083305728:12345-0@lo:400: Request processed in 43us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789760799.628477:0:6431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789760799.628491:0:3429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789760799.628517:0:3430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bf1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3430:1876700083305728:0@lo:400: 00000100:00100000:0.0:1789760799.628543:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f85ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:751d7670-4ea9-4485-a191-8db5c056760e:3429:1876700083304960:0@lo:400: 00000100:00080000:2.0:1789760799.628556:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789760799.628568:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330b5bece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3429:1876700083304576:0@lo:41: 00000100:00100000:3.0:1789760799.629199:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305600 00000100:00100000:3.0:1789760799.629205:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305600 00000100:00100000:1.0:1789760799.629263:0:6429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760799.629274:0:6429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330bf1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3429:x1876700083305600:12345-0@lo:400: 00000100:00080000:2.0:1789760799.629285:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789760799.629317:0:6429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330bf1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3429:x1876700083305600:12345-0@lo:400: Request processed in 45us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789760799.629324:0:6429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789760799.629967:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff932f845b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3431:1876700083305344:0@lo:400: 00000100:00100000:1.0:1789760799.629978:0:3431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9330bf1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3431:1876700083305856:0@lo:400: 00000100:00100000:1.0:1789760799.630087:0:3431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789760799.630172:0:9043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876700083305856 00000100:00100000:3.0:1789760799.630177:0:9043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876700083305856 00000100:00100000:3.0:1789760799.630234:0:9043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789760799.630241:0:9043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9330a0844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3431:x1876700083305856:12345-0@lo:400: 00000100:00100000:3.0:1789760799.630282:0:9043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9330a0844380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3431:x1876700083305856:12345-0@lo:400: Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789760799.630301:0:9043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789760799.630319:0:6426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789760799.633197:0:3429:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bf1f9500 x1876700083305600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760799.633215:0:3429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bf1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3429:1876700083305600:0@lo:400: 00010000:00080000:1.0:1789760799.633258:0:3431:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9330bf1f9c00 x1876700083305856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789760815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789760799.633285:0:3431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9330bf1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3431:1876700083305856:0@lo:400: 00010000:00010000:3.0:1789760800.070386:0:6419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 7897 lines, 7897 kept, 0 dropped, 0 bad.