00000001:02000400:3.0F:1787759135.584432:0:2978:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787759144.237045:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787759145.316084:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1179 MB/s 00000001:01000000:2.0:1787759145.566070:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1235 MB/s 00000001:01000000:2.0:1787759145.815820:0:3222:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9107 MB/s 00000020:02000000:2.0:1787759146.179405:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g734b157 00000400:02000000:3.0:1787759146.563020:0:3287:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.109@tcp [8/256/0/180] 00008000:02000000:0.0:1787759149.298255:0:3436:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787759175.939276:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787759179.884244:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787759179.884248:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787759179.884386:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000624e2b08 00000080:02000400:3.0:1787759179.884396:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787759179.888172:0:5814:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787759179.888185:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787759179.888236:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000920f5519) 00000020:00000080:3.0:1787759179.888255:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787759179.898455:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787759179.898867:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787759179.913837:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787759179.913871:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787759179.913890:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787759179.913941:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787759179.913966:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787759179.914293:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787759179.914302:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787759179.914311:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dcc6 00000020:01000004:2.0:1787759179.914317:0:5814:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787759179.914322:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787759179.914326:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000624e2b08 from MGS 00000020:01000004:2.0:1787759179.914329:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787759179.914345:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ba9cc5ba) 00000020:00000080:2.0:1787759179.914356:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787759179.914444:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000624e2b08 from MGS, refs=2 00080000:01000000:2.0:1787759179.914449:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787759179.914454:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dcd4 00000100:00100000:2.0:1787759179.914551:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787759179.914685:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787759179.914692:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787759179.915169:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787759179.915176:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787759179.915991:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759179.916088:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787759179.916091:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787759179.916485:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787759179.916493:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787759179.916724:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787759179.916729:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787759179.917575:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759179.917579:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759179.917582:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759179.918059:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759179.918062:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759179.918063:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759179.918521:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787759179.920914:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787759180.167782:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6171 MB/s 00000001:01000000:0.0:1787759180.417816:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7667 MB/s 00000001:01000000:1.0F:1787759180.668237:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1307 MB/s 00000001:01000000:1.0:1787759180.917979:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1603 MB/s 00080000:10000000:1.0:1787759180.927065:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787759180.936225:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787759180.936243:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787759180.936245:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787759180.936859:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787759180.936890:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787759180.936925:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787759180.937064:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787759180.937087:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787759180.939576:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759180.939820:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787759180.939827:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787759180.940384:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787759180.940391:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787759180.940689:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787759180.940696:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787759180.941300:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787759180.941317:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.109@tcp' 00000020:01000004:2.0:1787759180.941318:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787759180.941360:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.109@tcp (typ=mgc) 00000020:00000080:2.0:1787759180.941371:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.109@tcp (00000000a4db17f4) 00000020:00000080:2.0:1787759180.941386:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787759180.941496:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d0865f36@MGC192.168.204.109@tcp: add connection 192.168.204.109@tcp at head 00010000:00010000:2.0:1787759180.941690:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.109@tcp-0 is initialized 00000040:01000000:2.0:1787759180.941697:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.109@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787759180.942080:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1787759180.942111:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787759180.942168:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.109@tcp (uuid 654ae17d-b69d-436d-8406-f726a2563564) 00000020:00000080:2.0:1787759180.942184:0:5814:0:(genops.c:1385:class_connect()) connect: client 654ae17d-b69d-436d-8406-f726a2563564, cookie 0xec1488f14640dce2 00000100:00080000:2.0:1787759180.942204:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.204.109@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787759180.942210:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.204.109@tcp: import 00000000d0865f36 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:2.0:1787759180.942240:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb77448b x1874601334276224/t0(0) o250->MGC192.168.204.109@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787759180.942268:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 654ae17d-b69d-436d-8406-f726a2563564->MGS 00000020:01000004:2.0:1787759180.942320:0:5814:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787759180.942324:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787759180.942333:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000050ea8fcf) 00000020:00000080:2.0:1787759180.942342:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787759180.942412:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eb77448b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:654ae17d-b69d-436d-8406-f726a2563564:3302:1874601334276224:0@lo:250: 00000100:00100000:0.0:1787759180.942496:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759180.942595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276224 00000100:00100000:0.0:1787759180.942602:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276224 00000100:00100000:0.0:1787759180.942650:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759180.942656:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000856f5994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874601334276224:12345-0@lo:250: 00010000:00080000:0.0:1787759180.942679:0:5826:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 654ae17d-b69d-436d-8406-f726a2563564@0@lo t0 exp 0000000000000000 cur 87 last 0 00000020:00000080:0.0:1787759180.942707:0:5826:0:(genops.c:1385:class_connect()) connect: client 654ae17d-b69d-436d-8406-f726a2563564, cookie 0xec1488f14640dcf0 00000100:00080000:0.0:1787759180.942883:0:5826:0:(import.c:65:import_set_state_nolock()) 00000000a2543777 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787759180.942944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000856f5994 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+5:3302:x1874601334276224:12345-0@lo:250: Request processed in 286us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759180.942952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759180.942984:0:3302:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.109@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787759180.942998:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.109@tcp: connect to target with instance 0 00000100:00080000:0.0:1787759180.943004:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.109@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787759180.943008:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787759180.943012:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000d0865f36 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787759180.943014:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787759180.943022:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787759180.943027:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eb77448b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:654ae17d-b69d-436d-8406-f726a2563564:3302:1874601334276224:0@lo:250: 00000100:00100000:2.0:1787759180.948324:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759180.948538:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787759180.948545:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787759180.949304:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787759180.949311:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787759180.949884:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787759180.949892:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787759180.950697:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759180.950962:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787759180.950969:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787759180.951825:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787759180.951833:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:1.0:1787759180.972896:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759180.978023:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759180.978238:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787759180.978245:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787759180.979304:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787759180.979321:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787759180.979791:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759180.979970:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787759180.979976:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787759180.980346:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787759180.980353:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787759180.980848:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759180.981007:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787759180.981012:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787759180.981378:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787759180.981386:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787759180.981843:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759180.982017:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787759180.982022:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787759180.984435:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787759180.984447:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787759180.997916:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759180.998116:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787759180.998122:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787759180.999556:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787759180.999565:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787759181.001406:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787759181.001419:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787759181.002724:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787759181.002746:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787759181.002769:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.109@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787759181.002898:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.109@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787759181.002933:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.109@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787759181.002938:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787759181.002940:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787759181.002941:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759181.002942:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759181.002944:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759181.002945:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759181.002946:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787759181.002948:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787759181.002949:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759181.002951:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759181.002952:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759181.002957:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787759181.002960:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787759181.002962:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787759181.002963:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787759181.002964:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759181.002965:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759181.002966:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759181.002967:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759181.002968:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787759181.002969:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787759181.002970:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759181.002971:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759181.002972:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759181.002973:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787759181.002996:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787759181.003011:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db7ff3ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276352:0@lo:253: 00000100:00100000:2.0:1787759181.003085:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.003134:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f98ca9b6 going to sleep for 11 seconds 00000100:00100000:1.0:1787759181.003152:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276352 00000100:00100000:1.0:1787759181.003160:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276352 00000100:00100000:1.0:1787759181.003238:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759181.003247:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000632e741a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+5:5814:x1874601334276352:12345-0@lo:253: 20000000:01000000:1.0:1787759181.003289:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787759181.003292:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787759181.003543:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787759181.003594:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787759181.003997:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787759181.004773:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787759181.004865:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787759181.004869:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787759181.004874:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787759181.004877:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787759181.004896:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787759181.005022:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759181.005251:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787759181.005263:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787759181.005309:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787759181.005355:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787759181.005390:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787759181.005468:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787759181.005477:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787759181.005517:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787759181.005524:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787759181.005555:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787759181.005562:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787759181.005600:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787759181.005656:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787759181.005698:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787759181.005703:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787759181.005716:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759181.005939:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787759181.005948:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787759181.005980:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787759181.006013:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787759181.006185:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787759181.006208:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787759181.006279:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787759181.006287:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787759181.006330:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787759181.006379:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787759181.006412:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787759181.006422:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787759181.006509:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787759181.006518:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787759181.006549:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787759181.006583:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787759181.006733:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787759181.006953:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787759181.006961:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787759181.007292:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787759181.007518:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787759181.007538:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.109@tcp for mdt 20000000:01000000:3.0:1787759181.007540:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.109@tcp (null) (null) (null) 00000040:00080000:3.0:1787759181.007574:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787759181.007579:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787759181.007595:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787759181.007599:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.109@tcp (null) (null) 00000040:00080000:3.0:1787759181.007633:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787759181.007642:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787759181.007809:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787759181.007845:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787759181.007907:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787759181.007911:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787759181.007916:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787759181.007922:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787759181.008292:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787759181.008385:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787759181.013973:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787759181.014046:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787759181.014121:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787759181.014142:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787759181.014144:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787759181.014147:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787759181.014174:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787759181.014177:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787759181.014220:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787759181.014222:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787759181.014694:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787759181.014980:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787759181.015020:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787759181.015055:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787759181.015067:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787759181.015068:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787759181.015424:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787759181.015579:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787759181.015599:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787759181.015628:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1787759181.015637:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759181.015639:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787759181.015643:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787759181.015663:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015680:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015690:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015697:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015703:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015720:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015726:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba41153c already unused, calling callback (00000000a84efb67) 00010000:00010000:3.0:1787759181.015729:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015737:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015774:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015783:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.015788:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba41153c/0xec1488f14640dcf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787759181.015803:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787759181.118576:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000632e741a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+5:5814:x1874601334276352:12345-0@lo:253: Request processed in 115324us (115484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.118593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759181.118607:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db7ff3ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276352:0@lo:253: 10000000:01000000:1.0:1787759181.118626:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787759181.118630:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787759181.118632:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787759181.118633:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759181.118635:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787759181.118636:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759181.118637:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759181.118639:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787759181.118640:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787759181.118642:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787759181.118658:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759181.118660:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787759181.118677:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000624e2b08 from lustre-MDT0000 10000000:01000000:1.0:1787759181.118703:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787759181.118706:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787759181.118710:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98fa9a7c0000 10000000:01000000:1.0:1787759181.118714:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787759181.118720:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98fa9a7c0000 from 1 10000000:01000000:1.0:1787759181.118722:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787759181.118775:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.118809:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.118816:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.118829:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276480:0@lo:101: 00000100:00100000:1.0:1787759181.118935:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.118968:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.119163:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276480 00000100:00100000:0.0:1787759181.119170:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276480 00000100:00100000:0.0:1787759181.119219:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787759181.119228:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c45d480 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+5:5814:x1874601334276480:12345-0@lo:101: 00010000:00010000:0.0:1787759181.119240:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759181.119253:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000745bf96a/0xec1488f14640dd05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dcfe expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.119304:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000745bf96a/0xec1488f14640dd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dcfe expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.119313:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000745bf96a/0xec1488f14640dd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dcfe expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.119321:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000745bf96a, rc 0) 00000100:00100000:0.0:1787759181.119364:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c45d480 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+6:5814:x1874601334276480:12345-0@lo:101: Request processed in 138us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.119371:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787759181.119399:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276480:0@lo:101: 00010000:00010000:1.0:1787759181.119412:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.119420:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.119465:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276608:0@lo:501: 00000100:00100000:1.0:1787759181.119489:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.119520:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:3.0:1787759181.119571:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276608 00000100:00100000:3.0:1787759181.119574:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276608 00000100:00100000:3.0:1787759181.119641:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759181.119648:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007589be4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+6:5814:x1874601334276608:12345-0@lo:501: 00000100:00100000:3.0:1787759181.119874:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007589be4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+6:5814:x1874601334276608:12345-0@lo:501: Request processed in 227us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787759181.119891:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759181.119939:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276608:0@lo:501: 10000000:01000000:1.0:1787759181.119960:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787759181.119968:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.119975:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 000000000d9bdf2b/0xec1488f14640dcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759181.119982:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fa851c2800 10000000:01000000:1.0:1787759181.119985:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787759181.119988:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98fa851c2800 10000000:01000000:1.0:1787759181.119991:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787759181.119993:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98fa851c2800 from 1 10000000:01000000:1.0:1787759181.119995:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787759181.120008:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120014:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120020:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.120031:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276736:0@lo:101: 00000100:00100000:1.0:1787759181.120054:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.120081:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.120095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276736 00000100:00100000:0.0:1787759181.120099:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276736 00000100:00100000:0.0:1787759181.120122:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787759181.120127:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5e89d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+6:5814:x1874601334276736:12345-0@lo:101: 00010000:00010000:0.0:1787759181.120134:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759181.120142:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a04ecf9/0xec1488f14640dd13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dd0c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.120154:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a04ecf9/0xec1488f14640dd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dd0c expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.120162:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a04ecf9/0xec1488f14640dd13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd0c expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.120168:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a04ecf9, rc 0) 00000100:00100000:0.0:1787759181.120206:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5e89d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+7:5814:x1874601334276736:12345-0@lo:101: Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.120212:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787759181.120221:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276736:0@lo:101: 00010000:00010000:1.0:1787759181.120230:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd13 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120242:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd13 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759181.120252:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787759181.120262:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd13 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120268:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 000000009e7552ff/0xec1488f14640dd0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd13 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759181.120273:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787759181.120276:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787759181.120279:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98fa851c2800 10000000:01000000:1.0:1787759181.120281:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787759181.120284:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787759181.120285:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787759181.120296:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120301:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120307:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.120317:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276864:0@lo:101: 00000100:00100000:1.0:1787759181.120351:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.120369:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:3.0:1787759181.120385:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276864 00000100:00100000:3.0:1787759181.120389:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276864 00000100:00100000:3.0:1787759181.120412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759181.120417:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c4d99c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+7:5814:x1874601334276864:12345-0@lo:101: 00010000:00010000:3.0:1787759181.120424:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759181.120430:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba41153c/0xec1488f14640dd21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dd1a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.120442:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba41153c/0xec1488f14640dd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dd1a expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.120449:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba41153c/0xec1488f14640dd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd1a expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.120455:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba41153c, rc 0) 00000100:00100000:3.0:1787759181.120480:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c4d99c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+8:5814:x1874601334276864:12345-0@lo:101: Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.120485:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787759181.120492:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276864:0@lo:101: 00010000:00010000:1.0:1787759181.120501:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.120508:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.120539:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276992:0@lo:501: 00000100:00100000:1.0:1787759181.120562:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.120583:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.120672:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334276992 00000100:00100000:0.0:1787759181.120677:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334276992 00000100:00100000:0.0:1787759181.120701:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787759181.120706:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005381abda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+8:5814:x1874601334276992:12345-0@lo:501: 00000100:00100000:0.0:1787759181.120868:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005381abda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+9:5814:x1874601334276992:12345-0@lo:501: Request processed in 162us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.120875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787759181.120886:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334276992:0@lo:501: 00000100:00100000:1.0:1787759181.120910:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277120:0@lo:503: 00000100:00100000:1.0:1787759181.120944:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.120971:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8d9d77c going to sleep for 11 seconds 00000100:00100000:3.0:1787759181.121026:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277120 00000100:00100000:3.0:1787759181.121030:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277120 00000100:00100000:3.0:1787759181.121055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759181.121060:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048324a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+9:5814:x1874601334277120:12345-0@lo:503: 00000100:00100000:3.0:1787759181.121200:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048324a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+9:5814:x1874601334277120:12345-0@lo:503: Request processed in 140us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.121207:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787759181.121456:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277120:0@lo:503: 00000100:00100000:1.0:1787759181.122942:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5856:1874601334277248:0@lo:502: 00000100:00100000:1.0:1787759181.122991:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.123026:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b714bf19 going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.123080:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277248 00000100:00100000:0.0:1787759181.123086:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277248 00000100:00100000:0.0:1787759181.123119:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787759181.123126:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e48eda31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+9:5856:x1874601334277248:12345-0@lo:502: 00000100:00100000:0.0:1787759181.123296:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e48eda31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+9:5856:x1874601334277248:12345-0@lo:502: Request processed in 170us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.123303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787759181.123315:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5856:1874601334277248:0@lo:502: 00000020:01000000:1.0:1787759181.123336:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759181.123346:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759181.123349:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787759181.123354:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787759181.123356:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787759181.123374:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c02b9688) 00000020:00000080:1.0:1787759181.123387:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787759181.123394:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787759181.123485:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787759181.123489:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dd2f 00000020:00000080:1.0:1787759181.123702:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787759181.123706:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759181.123708:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759181.123709:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787759181.123711:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759181.123714:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759181.123715:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787759181.123718:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787759181.123723:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009be4d915) 00000020:00000080:1.0:1787759181.123732:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787759181.123737:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787759181.123738:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787759181.123740:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787759181.123746:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787759181.123886:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000624e2b08 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787759181.123895:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e777dea0) 00000020:00000080:1.0:1787759181.123901:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787759181.123949:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787759181.123954:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xec1488f14640dd44 00000020:00000080:1.0:1787759181.124054:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787759181.124060:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787759181.124064:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xec1488f14640dd4b 00080000:01000000:1.0:1787759181.124069:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787759181.124072:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dd52 00080000:10000000:1.0:1787759181.124420:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787759181.124541:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787759181.127425:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787759181.170024:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787759181.170335:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787759181.172465:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787759181.172659:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787759181.186980:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000570bb595) 00000020:00000080:3.0:1787759181.187002:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787759181.187076:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787759181.187085:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dd60 00000020:00000080:1.0:1787759181.187924:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787759181.189441:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759181.208794:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759181.225873:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759181.248486:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759181.269064:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787759181.285073:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787759181.302554:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xec1488f14640dd67 00000020:00000080:3.0:1787759181.303394:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787759181.303407:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759181.303413:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759181.303415:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787759181.303419:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759181.303425:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759181.303426:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787759181.303430:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787759181.303477:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787759181.303497:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759181.303501:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759181.303502:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787759181.303505:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759181.303508:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759181.303509:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759181.303512:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759181.303513:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787759181.303555:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5856:1874601334277376:0@lo:502: 00000100:00100000:3.0:1787759181.303641:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759181.303725:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0836a59 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.303795:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277376 00000100:00100000:2.0:1787759181.303802:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277376 00000100:00100000:2.0:1787759181.303852:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759181.303865:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000232d13cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+9:5856:x1874601334277376:12345-0@lo:502: 00000100:00100000:2.0:1787759181.304513:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000232d13cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+9:5856:x1874601334277376:12345-0@lo:502: Request processed in 653us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.304522:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759181.304561:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5856:1874601334277376:0@lo:502: 00000020:01000000:3.0:1787759181.304590:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759181.304595:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759181.304596:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759181.304600:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787759181.304683:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787759181.304703:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787759181.304725:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.304737:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 000000005781276a/0xec1488f14640dd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759181.304745:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98fa851c2800 from 1 10000000:01000000:2.0:1787759181.304748:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787759181.304790:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.304797:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.304806:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759181.304818:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000177e7f41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277504:0@lo:101: 00000100:00100000:2.0:1787759181.304859:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.304891:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8172340 going to sleep for 11 seconds 00000100:00100000:1.0:1787759181.304922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277504 00000100:00100000:1.0:1787759181.304928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277504 00000100:00100000:1.0:1787759181.304961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787759181.304969:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deb61762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+9:5814:x1874601334277504:12345-0@lo:101: 00010000:00010000:1.0:1787759181.304977:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759181.304989:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dd6e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.305063:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dd6e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.305073:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd6e expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.305081:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003339716c, rc 0) 00000100:00100000:1.0:1787759181.305118:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deb61762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+10:5814:x1874601334277504:12345-0@lo:101: Request processed in 152us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759181.305124:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787759181.305168:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000177e7f41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277504:0@lo:101: 00010000:00010000:2.0:1787759181.305192:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.305201:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759181.305820:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000177e7f41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277632:0@lo:256: 00000100:00100000:2.0:1787759181.305859:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.305882:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8172340 going to sleep for 11 seconds 00000100:00100000:3.0:1787759181.305940:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277632 00000100:00100000:3.0:1787759181.305946:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277632 00000100:00100000:3.0:1787759181.305978:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759181.305985:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072c579c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5814:x1874601334277632:12345-0@lo:256: 20000000:01000000:3.0:1787759181.306012:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787759181.306018:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787759181.306089:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072c579c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5814:x1874601334277632:12345-0@lo:256: Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.306096:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787759181.306175:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000177e7f41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277632:0@lo:256: 10000000:01000000:1.0:1787759181.306881:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787759181.306901:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.306921:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759181.306928:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa851c2800 from 1 10000000:01000000:1.0:1787759181.306931:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787759181.306951:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.306957:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.306965:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.306976:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277760:0@lo:101: 00000100:00100000:1.0:1787759181.307003:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.307031:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ca7ae3a going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.307088:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277760 00000100:00100000:0.0:1787759181.307093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277760 00000100:00100000:0.0:1787759181.307129:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787759181.307135:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e607e851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+10:5814:x1874601334277760:12345-0@lo:101: 00010000:00010000:0.0:1787759181.307144:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759181.307154:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dd7c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.307173:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.307194:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.307201:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf4ab9d2, rc 0) 00000100:00100000:1.0:1787759181.307285:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277760:0@lo:101: 00010000:00010000:1.0:1787759181.307296:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.307303:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759181.307348:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277888:0@lo:501: 00000100:00100000:0.0:1787759181.307402:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e607e851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334277760:12345-0@lo:101: Request processed in 266us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.307413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787759181.307413:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.307440:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ca7ae3a going to sleep for 11 seconds 00000100:00100000:0.0:1787759181.307446:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334277888 00000100:00100000:0.0:1787759181.307451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334277888 00000100:00100000:0.0:1787759181.307478:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787759181.307483:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cd5fa0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334277888:12345-0@lo:501: 00000100:00100000:0.0:1787759181.308029:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cd5fa0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334277888:12345-0@lo:501: Request processed in 547us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.308035:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787759181.308125:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334277888:0@lo:501: 00000100:00100000:1.0:1787759181.308152:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278016:0@lo:503: 00000100:00100000:1.0:1787759181.308202:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.308226:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ca7ae3a going to sleep for 11 seconds 00000100:00100000:3.0:1787759181.308251:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278016 00000100:00100000:3.0:1787759181.308256:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278016 00000100:00100000:3.0:1787759181.308282:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759181.308288:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000217c2208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334278016:12345-0@lo:503: 00000040:00080000:3.0:1787759181.308323:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787759181.308366:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000217c2208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334278016:12345-0@lo:503: Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.308374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759181.308501:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278016:0@lo:503: 00000040:00080000:1.0:1787759181.309981:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787759181.310094:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787759181.310114:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759181.310130:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.310139:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759181.310176:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787759181.310178:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fa851c2800 10000000:01000000:2.0:1787759181.310191:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fa851c2800 10000000:01000000:2.0:1787759181.310195:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787759181.310200:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa851c2800 from 1 10000000:01000000:2.0:1787759181.310202:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787759181.310224:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.310230:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.310237:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759181.310261:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041a977a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278144:0@lo:101: 00000100:00100000:2.0:1787759181.310301:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.310330:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8172340 going to sleep for 11 seconds 00000100:00100000:1.0:1787759181.310343:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278144 00000100:00100000:1.0:1787759181.310349:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278144 00000100:00100000:1.0:1787759181.310389:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759181.310397:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f95b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334278144:12345-0@lo:101: 00010000:00010000:1.0:1787759181.310406:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759181.310415:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bd6b88f6/0xec1488f14640dd91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dd8a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.310432:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bd6b88f6/0xec1488f14640dd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.310442:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bd6b88f6/0xec1488f14640dd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.310449:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bd6b88f6, rc 0) 00000100:00100000:1.0:1787759181.310487:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f95b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278144:12345-0@lo:101: Request processed in 90us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759181.310495:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787759181.310523:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041a977a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278144:0@lo:101: 00010000:00010000:3.0:1787759181.310535:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759181.310544:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759181.310586:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278272:0@lo:501: 00000100:00100000:3.0:1787759181.310683:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759181.310708:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079052969 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.310896:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278272 00000100:00100000:2.0:1787759181.310901:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278272 00000100:00100000:2.0:1787759181.310937:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787759181.311001:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003f0f5d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278272:12345-0@lo:501: 00000100:00100000:2.0:1787759181.311321:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003f0f5d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278272:12345-0@lo:501: Request processed in 329us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.311329:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787759181.311352:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278272:0@lo:501: 00000100:00100000:3.0:1787759181.311386:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278400:0@lo:503: 00000100:00100000:3.0:1787759181.311412:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759181.311434:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079052969 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.311470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278400 00000100:00100000:2.0:1787759181.311475:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278400 00000100:00100000:2.0:1787759181.311503:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787759181.311510:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000429bd5e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278400:12345-0@lo:503: 00000100:00100000:2.0:1787759181.311918:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000429bd5e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278400:12345-0@lo:503: Request processed in 408us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.311926:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759181.311942:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f557229 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278400:0@lo:503: 00000100:00100000:1.0:1787759181.312325:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5861:1874601334278528:0@lo:502: 00000100:00100000:1.0:1787759181.312357:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.312383:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034994f30 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.312456:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278528 00000100:00100000:2.0:1787759181.312462:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278528 00000100:00100000:2.0:1787759181.312488:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787759181.312494:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000468db2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5861:x1874601334278528:12345-0@lo:502: 00000100:00100000:2.0:1787759181.312667:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000468db2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5861:x1874601334278528:12345-0@lo:502: Request processed in 174us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.312675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787759181.313086:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000015474281 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5861:1874601334278528:0@lo:502: 00000020:01000004:2.0:1787759181.313143:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787759181.313155:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003048f462) 00000020:00000080:2.0:1787759181.313172:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787759181.313262:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000624e2b08 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787759181.313266:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000624e2b08 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787759181.313269:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000624e2b08 4 00010000:00080000:2.0:1787759181.313294:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000082d04af8@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.109@tcp at head 00010000:00010000:2.0:1787759181.314911:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787759181.315093:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787759181.315120:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787759181.315130:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xec1488f14640dd9f 00000100:00080000:2.0:1787759181.315138:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787759181.315143:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000082d04af8 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:2.0:1787759181.315171:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef8a8c4d x1874601334278656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787759181.315208:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787759181.315403:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef8a8c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601334278656:0@lo:38: 00000100:00100000:0.0:1787759181.315464:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759181.315516:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278656 00000100:00100000:1.0:1787759181.315523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278656 00000100:00100000:1.0:1787759181.315562:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759181.315569:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046b0fedb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874601334278656:12345-0@lo:38: 00000100:00100000:2.0:1787759181.315611:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe531b pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5861:1874601334278784:0@lo:502: 00000100:00100000:1.0:1787759181.315619:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046b0fedb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874601334278656:12345-0@lo:38: Request processed in 49us (154us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787759181.315626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759181.315659:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.315687:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278784 00000100:00100000:2.0:1787759181.315691:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278784 00000100:00100000:2.0:1787759181.315721:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787759181.315729:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e7504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5861:x1874601334278784:12345-0@lo:502: 00000100:00100000:2.0:1787759181.315957:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e7504e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5861:x1874601334278784:12345-0@lo:502: Request processed in 230us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.315965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787759181.316008:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f98ca9b6 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.316033:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe531b pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:5861:1874601334278784:0@lo:502: 00000040:00080000:2.0:1787759181.316059:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1787759181.316061:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787759181.316066:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000082d04af8 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787759181.316070:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787759181.316073:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef8a8c4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601334278656:0@lo:38: 00000020:01000000:0.0:1787759181.316207:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787759181.316224:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759181.316242:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.316250:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 00000000b6bf317b/0xec1488f14640dd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787759181.316287:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787759181.316289:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787759181.316290:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759181.316291:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759181.316296:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759181.316297:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759181.316298:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787759181.316299:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787759181.316299:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759181.316300:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759181.316301:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759181.316302:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787759181.316305:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787759181.316306:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787759181.316307:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787759181.316308:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759181.316309:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759181.316309:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759181.316310:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759181.316310:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787759181.316311:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787759181.316311:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759181.316312:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759181.316313:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759181.316313:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787759181.316326:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787759181.316332:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7ab4864 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278912:0@lo:253: 00000100:00100000:0.0:1787759181.316373:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759181.316392:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038152c68 going to sleep for 11 seconds 00000100:00100000:2.0:1787759181.316408:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334278912 00000100:00100000:2.0:1787759181.316412:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334278912 00000100:00100000:2.0:1787759181.316444:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787759181.316450:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb360491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5814:x1874601334278912:12345-0@lo:253: 20000000:01000000:2.0:1787759181.316467:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787759181.316489:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787759181.332674:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787759181.332727:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787759181.332835:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787759181.332840:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787759181.332861:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.332885:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd6e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.332893:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.332931:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.332957:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 12 pid: 5827 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759181.332972:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea98481d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334279040:0@lo:104: 00000100:00100000:0.0:1787759181.333041:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759181.333124:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c41c1c18 going to sleep for 11 seconds 00000100:00100000:1.0:1787759181.333174:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279040 00000100:00100000:1.0:1787759181.333193:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279040 00000100:00100000:1.0:1787759181.333247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759181.333255:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d0b84e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334279040:12345-0@lo:104: 00010000:00010000:1.0:1787759181.333267:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759181.333364:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787759181.333370:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d0b84e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334279040:12345-0@lo:104: Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759181.333377:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759181.333428:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea98481d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334279040:0@lo:104: 00010000:00010000:0.0:1787759181.333444:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334015:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759181.334021:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334029:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000101dfbf7 already unused, calling callback (00000000a0c486aa) 10000000:00010000:2.0:1787759181.334032:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334039:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759181.334045:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759181.334051:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787759181.334083:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334090:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759181.334108:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334114:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: 00000000101dfbf7/0xec1488f14640dd6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd75 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334129:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759181.334131:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759181.334132:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759181.334193:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f6fe531b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334279168:0@lo:103: 00000100:00100000:2.0:1787759181.334234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759181.334313:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279168 00000100:00100000:2.0:1787759181.334318:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279168 00010000:00010000:2.0:1787759181.334334:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 13 pid: 5827 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759181.334364:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759181.334371:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8a8c4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3304:x1874601334279168:12345-0@lo:103: 00010000:00010000:2.0:1787759181.334380:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759181.334385:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 13 pid: 5827 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334394:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 13 pid: 5827 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334404:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003339716c/0xec1488f14640dd75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dd6e expref: 13 pid: 5827 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334422:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334427:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787759181.334436:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001596763s 00010000:00010000:2.0:1787759181.334438:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334442:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334453:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334456:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334459:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d22bee56 already unused, calling callback (00000000a84efb67) 00010000:00010000:2.0:1787759181.334461:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334465:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334476:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759181.334484:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759181.334502:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759181.334510:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759181.334522:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8a8c4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+12:3304:x1874601334279168:12345-0@lo:103: Request processed in 152us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.334533:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759181.334546:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f6fe531b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334279168:0@lo:103: 00010000:00010000:0.0:1787759181.334588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d22bee56/0xec1488f14640dda6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759181.337362:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb360491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5814:x1874601334278912:12345-0@lo:253: Request processed in 20904us (20980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.337378:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787759181.337503:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7ab4864 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:5814:1874601334278912:0@lo:253: 10000000:01000000:3.0:1787759181.337515:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787759181.337517:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759181.337518:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787759181.337519:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759181.337521:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759181.337521:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759181.337522:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759181.337523:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787759181.337524:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787759181.337525:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759181.337525:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759181.337526:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759181.337527:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787759181.337538:0:5814:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787759181.342890:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759181.343111:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759181.343305:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759181.343601:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759181.343819:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759181.343993:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787759181.344621:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787759181.345191:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787759181.345366:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787759181.345516:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787759181.345741:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787759181.346062:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787759181.367798:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787759181.385304:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787759181.385379:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787759181.385383:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787759181.385777:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787759181.389668:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787759181.390284:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787759181.390785:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787759181.390793:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787759181.391017:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759181.392100:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787759181.392638:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787759181.392684:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787759181.392832:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787759181.392953:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787759181.394645:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787759181.394829:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787759181.395240:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787759181.395607:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787759181.395882:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787759181.395971:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787759181.396115:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787759181.396345:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787759181.396639:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787759181.396984:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787759181.397250:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787759181.397537:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787759181.397792:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787759181.397992:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787759181.398245:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787759181.398446:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787759181.398821:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787759181.398936:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787759181.399052:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787759181.399159:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787759181.399303:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787759181.399416:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787759181.399574:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787759181.399728:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787759181.399916:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787759181.400121:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787759181.400292:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787759181.400452:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787759181.400605:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787759181.400741:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787759181.400941:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787759181.401107:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787759181.401341:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787759181.401797:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787759181.425539:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787759181.425586:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb07fc18b3988 00100000:10000000:0.0:1787759181.425594:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787759181.425893:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787759181.425909:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.109@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787759181.425924:0:5814:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1787759181.425941:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787759181.443265:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787759181.443348:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787759181.443353:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787759181.996961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759183.021378:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759183.175516:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787759184.044875:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759185.068900:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787759185.997588:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcfcce980 20000000:00000080:1.0:1787759185.997606:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98faaf319c00 uarg=0000000000000000 20000000:01000000:1.0:1787759185.997640:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787759185.997646:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787759185.997651:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787759185.997876:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787759185.997890:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787759186.001445:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787759186.001641:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787759186.001679:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787759186.001723:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787759186.001739:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787759186.001844:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.001859:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd7c expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.001863:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.001892:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.001903:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 10 pid: 5827 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759186.001912:0:6311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5017d73 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874601334279296:0@lo:104: 00000100:00100000:1.0:1787759186.001960:0:6311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759186.001995:0:6311:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f16bd252 going to sleep for 11 seconds 00000100:00100000:3.0:1787759186.002571:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279296 00000100:00100000:3.0:1787759186.002586:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279296 00000100:00100000:3.0:1787759186.002633:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759186.002643:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000916f37d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:6311:x1874601334279296:12345-0@lo:104: 00010000:00010000:3.0:1787759186.002663:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759186.002740:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759186.002745:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000916f37d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:6311:x1874601334279296:12345-0@lo:104: Request processed in 105us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759186.002785:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759186.002788:0:6311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5017d73 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1874601334279296:0@lo:104: 00010000:00010000:1.0:1787759186.002809:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002876:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759186.002881:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002887:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000011a1fe9a already unused, calling callback (00000000a0c486aa) 10000000:00010000:2.0:1787759186.002890:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002895:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759186.002899:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759186.002902:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787759186.002926:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002930:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759186.002947:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002952:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: 0000000011a1fe9a/0xec1488f14640dd7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd83 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.002964:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759186.002965:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759186.002966:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759186.002999:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759186.003011:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000434242f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334279424:0@lo:103: 00000100:00100000:0.0:1787759186.003041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759186.003081:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279424 00000100:00100000:2.0:1787759186.003085:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279424 00010000:00010000:2.0:1787759186.003114:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759186.003157:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759186.003163:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001063d2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+11:3306:x1874601334279424:12345-0@lo:103: 00010000:00010000:2.0:1787759186.003174:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759186.003178:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003186:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003198:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640dd83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dd7c expref: 11 pid: 5827 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003210:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003217:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003229:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003235:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003241:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003246:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003261:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046f79a3f already unused, calling callback (00000000a84efb67) 00010000:00010000:2.0:1787759186.003264:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003270:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003282:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759186.003291:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759186.003299:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.003306:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759186.003311:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046f79a3f/0xec1488f14640ddad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759186.003335:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001063d2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+10:3306:x1874601334279424:12345-0@lo:103: Request processed in 173us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759186.003341:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787759186.003503:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000434242f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334279424:0@lo:103: 00010000:00010000:1.0:1787759186.094015:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787759186.669374:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787759186.669385:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787759186.669388:0:37:0:(import.c:65:import_set_state_nolock()) 0000000082d04af8 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787759186.669423:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000082d04af8 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:0.0:1787759186.669446:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d3825525 x1874601334279680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787759186.669481:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3825525 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601334279680:0@lo:38: 00000100:00100000:0.0:1787759186.669566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759186.669588:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759186.669605:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056d2293f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334279552:0@lo:400: 00000100:00100000:2.0:1787759186.669648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759186.669834:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279552 00000100:00100000:1.0:1787759186.669836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279680 00000100:00100000:0.0:1787759186.669842:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279552 00000100:00100000:1.0:1787759186.669843:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279680 00000100:00100000:1.0:1787759186.669876:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759186.669881:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea98481d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874601334279680:12345-0@lo:38: 00000100:00100000:0.0:1787759186.669893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787759186.669902:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ad80635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:3305:x1874601334279552:12345-0@lo:400: 00010000:00080000:1.0:1787759186.669905:0:5835:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 93 last 0 00000020:00000080:1.0:1787759186.669943:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xec1488f14640ddb4 00000100:00100000:0.0:1787759186.669967:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ad80635 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:3305:x1874601334279552:12345-0@lo:400: Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759186.669976:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000004:00100000:1.0:1787759186.669981:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787759186.670034:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056d2293f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334279552:0@lo:400: 00000100:00080000:1.0:1787759186.670177:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000894d3114 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787759186.670236:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea98481d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874601334279680:12345-0@lo:38: Request processed in 353us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759186.670245:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787759186.670274:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d3825525 x1874601334279680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787759186.670287:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787759186.670293:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787759186.670297:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787759186.670300:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000082d04af8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787759186.670305:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3825525 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601334279680:0@lo:38: 00010000:00010000:2.0:1787759187.116877:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787759187.692818:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787759187.692833:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98fa851c2800 from 3 10000000:01000000:0.0:1787759187.692839:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787759187.692882:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759187.692895:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759187.692906:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759187.692930:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3825525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334279808:0@lo:101: 00000100:00100000:0.0:1787759187.692998:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759187.693053:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e1c1d324 going to sleep for 11 seconds 00000100:00100000:1.0:1787759187.693084:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279808 00000100:00100000:1.0:1787759187.693093:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279808 00000100:00100000:1.0:1787759187.693156:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759187.693165:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009190b031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334279808:12345-0@lo:101: 00010000:00010000:1.0:1787759187.693178:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759187.693191:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000525c93e6/0xec1488f14640ddc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640ddbb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759187.693220:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000525c93e6/0xec1488f14640ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640ddbb expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759187.693230:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000525c93e6/0xec1488f14640ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640ddbb expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759187.693239:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000525c93e6, rc 0) 00000100:00100000:1.0:1787759187.693293:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009190b031 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334279808:12345-0@lo:101: Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759187.693300:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787759187.693397:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3825525 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334279808:0@lo:101: 00010000:00010000:3.0:1787759187.693414:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.693424:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759187.693478:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334279936:0@lo:256: 00000100:00100000:3.0:1787759187.693515:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759187.693541:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2f424e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787759187.693787:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334279936 00000100:00100000:0.0:1787759187.693792:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334279936 00000100:00100000:0.0:1787759187.693820:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787759187.693826:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000635742c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334279936:12345-0@lo:256: 20000000:01000000:0.0:1787759187.693841:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787759187.693854:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787759187.693858:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787759187.693934:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000635742c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334279936:12345-0@lo:256: Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759187.693942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787759187.693986:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334279936:0@lo:256: 10000000:01000000:3.0:1787759187.694037:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787759187.694043:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.694051:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: 00000000b40dccc8/0xec1488f14640ddbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759187.694070:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787759187.694072:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa851c2800 from 1 10000000:01000000:3.0:1787759187.694074:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759187.694098:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: 00000000995af9a4/0xec1488f14640ddc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.694106:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: 00000000995af9a4/0xec1488f14640ddc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.694113:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: 00000000995af9a4/0xec1488f14640ddc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759187.694134:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280064:0@lo:101: 00000100:00100000:3.0:1787759187.694157:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759187.694184:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2f424e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787759187.694215:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280064 00000100:00100000:0.0:1787759187.694221:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280064 00000100:00100000:0.0:1787759187.694253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787759187.694260:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b401a99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334280064:12345-0@lo:101: 00010000:00010000:0.0:1787759187.694268:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759187.694278:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640ddd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640ddc9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759187.694299:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640ddd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759187.694308:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf4ab9d2/0xec1488f14640ddd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759187.694314:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf4ab9d2, rc 0) 00000100:00100000:0.0:1787759187.694413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b401a99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334280064:12345-0@lo:101: Request processed in 153us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759187.694422:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787759187.694535:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280064:0@lo:101: 00010000:00010000:3.0:1787759187.694546:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: 00000000995af9a4/0xec1488f14640ddc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.694554:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: 00000000995af9a4/0xec1488f14640ddc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759187.694604:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280192:0@lo:501: 00000100:00100000:3.0:1787759187.694631:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759187.694692:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2f424e8 going to sleep for 11 seconds 00000100:00100000:1.0:1787759187.694724:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280192 00000100:00100000:1.0:1787759187.694728:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280192 00000100:00100000:1.0:1787759187.694850:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787759187.694858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5453e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334280192:12345-0@lo:501: 00000100:00100000:1.0:1787759187.695123:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5453e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334280192:12345-0@lo:501: Request processed in 266us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759187.695130:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787759187.695189:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280192:0@lo:501: 00000100:00100000:3.0:1787759187.695214:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280320:0@lo:503: 00000100:00100000:3.0:1787759187.695250:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759187.695327:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2f424e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787759187.695352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280320 00000100:00100000:0.0:1787759187.695356:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280320 00000100:00100000:0.0:1787759187.695374:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787759187.695389:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db7b6111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334280320:12345-0@lo:503: 00000100:00100000:0.0:1787759187.695530:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db7b6111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334280320:12345-0@lo:503: Request processed in 150us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759187.695537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787759187.695654:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d1ec54a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334280320:0@lo:503: 00000100:00100000:1.0:1787759187.696134:0:6576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041bac2e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:6576:1874601334280448:0@lo:502: 00000100:00100000:1.0:1787759187.696188:0:6576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759187.696216:0:6576:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fdcd9d08 going to sleep for 11 seconds 00000100:00100000:0.0:1787759187.696306:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280448 00000100:00100000:0.0:1787759187.696312:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280448 00000100:00100000:0.0:1787759187.696352:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787759187.696362:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078709313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6576:x1874601334280448:12345-0@lo:502: 00000100:00100000:0.0:1787759187.696530:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078709313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6576:x1874601334280448:12345-0@lo:502: Request processed in 171us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759187.696539:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787759187.696653:0:6576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041bac2e5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:6576:1874601334280448:0@lo:502: 00000020:01000000:1.0:1787759187.696678:0:6576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759187.696687:0:6576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759187.696699:0:6576:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787759187.696707:0:6576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fa851c2800 00000020:00000080:1.0:1787759187.696710:0:6576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787759187.696780:0:6576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:6576:1874601334280576:0@lo:502: 00000100:00100000:1.0:1787759187.696817:0:6576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759187.697226:0:6576:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa86882780 going to sleep for 11 seconds 00000100:00100000:2.0:1787759187.697243:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280576 00000100:00100000:2.0:1787759187.697249:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280576 00000100:00100000:2.0:1787759187.697284:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787759187.697301:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:6576:x1874601334280576:12345-0@lo:502: 00000100:00100000:2.0:1787759187.697455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:6576:x1874601334280576:12345-0@lo:502: Request processed in 164us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759187.697465:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787759187.697482:0:6576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:6576:1874601334280576:0@lo:502: 00000020:01000000:1.0:1787759187.697570:0:6576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759187.697575:0:6576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759187.697577:0:6576:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787759187.697582:0:6576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787759187.698472:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787759187.698499:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759187.698510:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759187.698522:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.141942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787759188.651357:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787759188.651361:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787759188.651495:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98fa82f2f000 00000020:01000004:0.0:1787759188.651514:0:6674:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787759188.651523:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787759188.651544:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98faae4eb490) 00000020:00000080:0.0:1787759188.651558:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787759188.670121:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787759188.670376:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787759188.685368:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787759188.688863:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787759188.688892:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787759188.688947:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787759188.688975:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787759188.689457:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787759188.689468:0:6674:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787759188.689478:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xec1488f14640ddde 00000020:01000004:3.0:1787759188.689485:0:6674:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787759188.689503:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.109@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787759188.689507:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787759188.689512:0:6674:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787759188.689516:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787759188.689526:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98fa851b8000) 00000020:00000080:3.0:1787759188.689536:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787759188.690591:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787759188.690767:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787759188.690781:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787759188.691968:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787759188.691977:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787759188.692440:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787759188.692446:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787759188.693870:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787759188.694022:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787759188.694026:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787759188.694524:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787759188.694531:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787759188.707643:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787759188.707907:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787759188.707921:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787759188.711708:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787759188.711727:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787759188.714226:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787759188.714237:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787759188.717423:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787759188.717621:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787759188.717627:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787759188.718202:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787759188.718210:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787759188.744438:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787759188.744628:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787759188.744634:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787759188.746172:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787759188.746183:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787759188.746512:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787759188.746537:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787759188.746542:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.109@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787759188.761171:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787759188.761209:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.109@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787759188.761213:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787759188.761220:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787759188.761221:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759188.761222:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759188.761223:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759188.761224:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759188.761225:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759188.761227:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759188.761228:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759188.761230:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759188.761230:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759188.761234:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787759188.761236:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787759188.761237:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787759188.761238:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759188.761238:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759188.761239:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759188.761240:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759188.761241:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759188.761242:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759188.761242:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759188.761243:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759188.761244:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759188.761270:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787759188.761288:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334280704:0@lo:253: 00000100:00100000:1.0:1787759188.761371:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.761423:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa903420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759188.761613:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280704 00000100:00100000:0.0:1787759188.761620:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280704 00000100:00100000:0.0:1787759188.761670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787759188.761680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334280704:12345-0@lo:253: 20000000:01000000:0.0:1787759188.761709:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787759188.761713:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787759188.761719:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787759188.761723:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787759188.762735:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759188.762961:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787759188.762975:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787759188.763016:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787759188.763024:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787759188.763072:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787759188.763121:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787759188.763575:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787759188.763594:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.109@tcp 20000000:01000000:0.0:1787759188.763596:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.109@tcp (null) (null) (null) 00000040:00080000:0.0:1787759188.763631:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787759188.763639:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787759188.763687:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787759188.763695:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.109@tcp (null) (null) 00000040:00080000:0.0:1787759188.763727:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787759188.763735:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787759188.763843:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787759188.763894:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787759188.764664:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787759188.764688:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.109@tcp 20000000:01000000:0.0:1787759188.764690:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.109@tcp (null) (null) (null) 00000040:00080000:0.0:1787759188.764726:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787759188.764734:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787759188.764934:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787759188.764942:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.109@tcp (null) (null) 00000040:00080000:0.0:1787759188.764993:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787759188.765003:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787759188.765032:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787759188.765076:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787759188.765091:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787759188.765093:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787759188.765099:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787759188.765101:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787759188.765103:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787759188.765125:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787759188.765128:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787759188.765159:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787759188.765161:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787759188.765688:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787759188.765736:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787759188.765899:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787759188.766194:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1787759188.766229:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1787759188.766255:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1787759188.766264:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787759188.766266:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787759188.766712:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787759188.766862:0:6690:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787759188.766928:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787759188.767151:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787759188.767186:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787759188.767238:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787759188.767250:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787759188.767252:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787759188.767697:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787759188.767966:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787759188.768001:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787759188.768067:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1787759188.768084:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787759188.768110:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768128:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dcfe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768136:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd1a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768143:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768150:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768186:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768199:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.768211:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334280832:0@lo:104: 00000100:00100000:0.0:1787759188.768270:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759188.768313:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768321:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 12 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.768329:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334280960:0@lo:104: 00000100:00100000:0.0:1787759188.768346:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759188.768461:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.768469:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 12 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.768476:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334281088:0@lo:104: 00000100:00100000:0.0:1787759188.768493:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.768606:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82c01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759188.768642:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280832 00000100:00100000:3.0:1787759188.768649:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280832 00000100:00100000:3.0:1787759188.768678:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334280960 00000100:00100000:3.0:1787759188.768681:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334280960 00000100:00100000:3.0:1787759188.768688:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281088 00000100:00100000:3.0:1787759188.768690:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281088 00000100:00100000:3.0:1787759188.768701:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759188.768708:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:5827:x1874601334280832:12345-0@lo:104: 00010000:00010000:3.0:1787759188.768719:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.768796:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759188.768801:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a386580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:5827:x1874601334280832:12345-0@lo:104: Request processed in 94us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.768808:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759188.768823:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759188.768828:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:5827:x1874601334280960:12345-0@lo:104: 00010000:00010000:3.0:1787759188.768835:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.768865:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787759188.768869:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:5827:x1874601334280960:12345-0@lo:104: Request processed in 42us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.768875:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759188.768886:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787759188.768891:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:5827:x1874601334281088:12345-0@lo:104: 00010000:00010000:3.0:1787759188.768898:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.768932:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787759188.768936:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:5827:x1874601334281088:12345-0@lo:104: Request processed in 46us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.768947:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787759188.768962:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787759188.768968:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.768976:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151b800 already unused, calling callback (ffffffffc1a5dc20) 00010000:00010000:2.0:1787759188.768977:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1787759188.768981:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.768991:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759188.768998:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.769004:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759188.769032:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769050:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759188.769070:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769077:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640dd8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd91 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.769087:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334281216:0@lo:103: 00010000:00010000:3.0:1787759188.769108:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759188.769112:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769119:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168ee00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759188.769122:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.769132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759188.769134:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759188.769142:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.769147:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759188.769164:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769170:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759188.769178:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281216 00000100:00100000:2.0:1787759188.769183:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281216 00010000:00010000:3.0:1787759188.769184:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769193:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640dcfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd05 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.769203:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769205:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769208:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769210:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759188.769227:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787759188.769235:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759188.769245:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334281344:0@lo:103: 00000100:00100000:2.0:1787759188.769246:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3303:x1874601334281216:12345-0@lo:103: 00010000:00010000:2.0:1787759188.769261:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759188.769267:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.769276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759188.769290:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.769308:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759188.769323:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787759188.769330:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787759188.769342:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3303:x1874601334281216:12345-0@lo:103: Request processed in 99us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.769350:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787759188.769362:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281344 00000100:00100000:2.0:1787759188.769365:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281344 00010000:00010000:2.0:1787759188.769376:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.769407:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759188.769414:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3303:x1874601334281344:12345-0@lo:103: 00010000:00010000:2.0:1787759188.769423:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759188.769429:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.769438:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 13 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.769449:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759188.769474:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3303:x1874601334281344:12345-0@lo:103: Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.769481:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759188.769530:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334281344:0@lo:103: 00000100:00100000:2.0:1787759188.769543:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334281216:0@lo:103: 00010000:00010000:3.0:1787759188.769560:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769567:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769575:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168e800 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759188.769579:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769585:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759188.769592:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.769597:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759188.769621:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769627:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759188.769641:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769648:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8168e800/0xec1488f14640dd1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dd21 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769662:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769663:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769670:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769675:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.769677:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759188.769705:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759188.769715:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334281472:0@lo:103: 00000100:00100000:3.0:1787759188.769740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.769785:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281472 00000100:00100000:3.0:1787759188.769789:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281472 00010000:00010000:3.0:1787759188.769802:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 13 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.769823:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787759188.769828:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+13:3306:x1874601334281472:12345-0@lo:103: 00010000:00010000:3.0:1787759188.769835:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759188.769839:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 13 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769848:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 13 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769860:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769868:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769881:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769889:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769906:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769913:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769920:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80030a00 already unused, calling callback (ffffffffc1462530) 00010000:00010000:3.0:1787759188.769924:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769931:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769939:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.769949:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759188.769982:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+13:3306:x1874601334281472:12345-0@lo:103: Request processed in 153us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.769989:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787759188.770010:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334281472:0@lo:103: 00010000:00010000:0.0:1787759188.770086:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168ec00/0xec1488f14640dd91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dd8a expref: 12 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.770097:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334280832:0@lo:104: 00010000:00010000:0.0:1787759188.770106:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c6600/0xec1488f14640dd21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dd1a expref: 11 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.770114:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334280960:0@lo:104: 00010000:00010000:0.0:1787759188.770122:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030800/0xec1488f14640dd05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dcfe expref: 10 pid: 5827 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.770131:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1874601334281088:0@lo:104: 00010000:00010000:0.0:1787759188.770150:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.770158:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.770165:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.770180:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030a00/0xec1488f14640ddec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787759188.770191:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787759188.796051:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+9:6674:x1874601334280704:12345-0@lo:253: Request processed in 34354us (34661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.796068:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787759188.796080:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334280704:0@lo:253: 10000000:01000000:3.0:1787759188.796094:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787759188.796097:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759188.796099:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787759188.796101:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759188.796102:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787759188.796103:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759188.796105:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759188.796106:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759188.796107:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787759188.796109:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759188.796122:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787759188.796142:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fa82f2f000 from lustre-OST0000 10000000:01000000:3.0:1787759188.796166:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787759188.796169:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787759188.796175:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fa9a7c0000 local copy 10000000:01000000:3.0:1787759188.796179:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787759188.796213:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.796225:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.796232:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.796245:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281600:0@lo:101: 00000100:00100000:3.0:1787759188.796271:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759188.796310:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281600 00000100:00100000:2.0:1787759188.796319:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281600 00000100:00100000:3.0:1787759188.796320:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.796353:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759188.796361:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+9:6674:x1874601334281600:12345-0@lo:101: 00010000:00010000:2.0:1787759188.796372:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759188.796383:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151b600/0xec1488f14640ddfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640ddf3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.796405:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151b600/0xec1488f14640ddfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640ddf3 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.796421:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151b600/0xec1488f14640ddfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640ddf3 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.796430:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151b600, rc 0) 00000100:00100000:2.0:1787759188.796459:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:6674:x1874601334281600:12345-0@lo:101: Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.796465:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787759188.796476:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281600:0@lo:101: 00010000:00010000:3.0:1787759188.796487:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.796561:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.796792:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281728:0@lo:501: 00000100:00100000:3.0:1787759188.796887:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.796959:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.796993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281728 00000100:00100000:1.0:1787759188.796997:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281728 00000100:00100000:1.0:1787759188.797028:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787759188.797045:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+10:6674:x1874601334281728:12345-0@lo:501: 00000100:00100000:1.0:1787759188.797220:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+10:6674:x1874601334281728:12345-0@lo:501: Request processed in 181us (328us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787759188.797235:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787759188.797258:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281728:0@lo:501: 10000000:01000000:3.0:1787759188.797273:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787759188.797316:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787759188.797327:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.797335:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.797342:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.797362:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787759188.797395:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fa82f2f000 10000000:01000000:3.0:1787759188.797400:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787759188.797405:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98fa9a7c0000 10000000:01000000:3.0:1787759188.797407:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787759188.797410:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98fa9a7c0000 from 1 10000000:01000000:3.0:1787759188.797412:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787759188.797427:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.797435:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797443:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759188.797443:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797451:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.797458:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281856:0@lo:101: 00010000:00010000:2.0:1787759188.797463:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c6200 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:2.0:1787759188.797468:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797477:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759188.797484:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.797490:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787759188.797513:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759188.797523:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00010000:00010000:2.0:1787759188.797536:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797544:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759188.797574:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797592:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fac21c6200/0xec1488f14640ddf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ddfa expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797609:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759188.797611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759188.797613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759188.797620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759188.797634:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334281984:0@lo:103: 00000100:00100000:0.0:1787759188.797668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.797672:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281856 00000100:00100000:1.0:1787759188.797677:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281856 00000100:00100000:1.0:1787759188.797705:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787759188.797712:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:6674:x1874601334281856:12345-0@lo:101: 00010000:00010000:1.0:1787759188.797720:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759188.797731:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168ec00/0xec1488f14640de08 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de01 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.797747:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168ec00/0xec1488f14640de08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de01 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.797781:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168ec00/0xec1488f14640de08 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de01 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.797787:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168ec00, rc 0) 00000100:00100000:1.0:1787759188.797829:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334281856:12345-0@lo:101: Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.797836:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787759188.797851:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334281856:0@lo:101: 00010000:00010000:3.0:1787759188.797880:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de08 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.797889:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de08 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.797905:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:2.0:1787759188.797913:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334281984 00010000:00010000:3.0:1787759188.797914:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de08 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.797919:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334281984 00010000:00010000:3.0:1787759188.797926:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7e00/0xec1488f14640de01 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de08 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.797933:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787759188.797937:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787759188.797941:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787759188.797943:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787759188.797956:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.797961:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787759188.797968:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.797973:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+11:3305:x1874601334281984:12345-0@lo:103: 00010000:00010000:3.0:1787759188.797986:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.797989:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787759188.798001:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282112:0@lo:101: 00010000:00010000:2.0:1787759188.798006:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151b600/0xec1488f14640ddfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xec1488f14640ddf3 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.798026:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759188.798030:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.798060:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282112 00000100:00100000:1.0:1787759188.798065:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282112 00000100:00100000:3.0:1787759188.798073:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.798078:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a386d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+11:3305:x1874601334281984:12345-0@lo:103: Request processed in 107us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.798086:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759188.798088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787759188.798094:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+10:6674:x1874601334282112:12345-0@lo:101: 00010000:00010000:1.0:1787759188.798100:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759188.798107:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de0f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.798121:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de0f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.798132:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de0f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.798137:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168e800, rc 0) 00000100:00100000:1.0:1787759188.798169:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282112:12345-0@lo:101: Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.798177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787759188.798206:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334281984:0@lo:103: 00000100:00100000:3.0:1787759188.798274:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282112:0@lo:101: 00010000:00010000:3.0:1787759188.798289:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.798296:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.798347:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282240:0@lo:501: 00000100:00100000:3.0:1787759188.798376:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.798451:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759188.798512:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282240 00000100:00100000:0.0:1787759188.798517:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282240 00000100:00100000:0.0:1787759188.798550:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787759188.798557:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282240:12345-0@lo:501: 00000100:00100000:0.0:1787759188.798738:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282240:12345-0@lo:501: Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759188.798746:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787759188.798787:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282240:0@lo:501: 00000100:00100000:3.0:1787759188.798816:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282368:0@lo:503: 00000100:00100000:3.0:1787759188.798850:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.798875:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.798921:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282368 00000100:00100000:1.0:1787759188.798926:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282368 00000100:00100000:1.0:1787759188.798959:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787759188.798966:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282368:12345-0@lo:503: 00000100:00100000:1.0:1787759188.799127:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282368:12345-0@lo:503: Request processed in 161us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.799134:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787759188.799180:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282368:0@lo:503: 00000040:00080000:3.0:1787759188.799408:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787759188.799469:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282496:0@lo:502: 00000100:00100000:3.0:1787759188.799512:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.799529:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759188.799747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282496 00000100:00100000:0.0:1787759188.799781:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282496 00000100:00100000:0.0:1787759188.799931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787759188.799939:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282496:12345-0@lo:502: 00000100:00100000:0.0:1787759188.800113:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282496:12345-0@lo:502: Request processed in 175us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759188.800120:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787759188.800506:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282496:0@lo:502: 00000040:00080000:3.0:1787759188.800951:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787759188.801002:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787759188.801052:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787759188.801122:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787759188.801165:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787759188.801193:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787759188.801221:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282624:0@lo:502: 00000100:00100000:3.0:1787759188.801269:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.801302:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa87dfdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.802744:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282624 00000100:00100000:1.0:1787759188.802773:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282624 00000100:00100000:1.0:1787759188.802840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787759188.802853:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282624:12345-0@lo:502: 00000100:00100000:1.0:1787759188.803144:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282624:12345-0@lo:502: Request processed in 293us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.803154:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787759188.803264:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282624:0@lo:502: 00000040:00080000:3.0:1787759188.803389:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787759188.803402:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787759188.804181:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787759188.804190:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787759188.804196:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759188.804199:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787759188.804204:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787759188.804218:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98fa86dd8000) 00000020:00000080:1.0:1787759188.804244:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787759188.804255:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787759188.804326:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fa82f2f000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787759188.804334:0:6694:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787759188.804340:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xec1488f14640de24 00010000:00010000:1.0:1787759188.808444:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787759188.808851:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787759188.818156:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787759188.818574:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787759188.824253:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787759188.824864:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787759188.826475:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787759188.826487:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759188.826492:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759188.826495:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787759188.826499:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759188.826503:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759188.826504:0:6694:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759188.826507:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759188.826509:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787759188.826547:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759188.826550:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759188.826552:0:6694:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759188.826555:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787759188.826790:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787759188.826814:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787759188.826836:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.826848:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759188.826857:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa82f2f000 from 1 10000000:01000000:1.0:1787759188.826860:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787759188.826893:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.826901:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.826911:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759188.826932:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282752:0@lo:101: 00000100:00100000:1.0:1787759188.827017:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759188.827108:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282752 00000100:00100000:2.0:1787759188.827115:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282752 00000100:00100000:1.0:1787759188.827131:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.827152:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787759188.827168:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:6674:x1874601334282752:12345-0@lo:101: 00010000:00010000:2.0:1787759188.827180:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759188.827193:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de2b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.827217:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.827237:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.827246:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151b600, rc 0) 00000100:00100000:2.0:1787759188.827297:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334282752:12345-0@lo:101: Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.827303:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787759188.827565:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282752:0@lo:101: 00010000:00010000:1.0:1787759188.827578:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.827607:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759188.827697:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282880:0@lo:501: 00000100:00100000:1.0:1787759188.827742:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759188.827869:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334282880 00000100:00100000:2.0:1787759188.827884:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334282880 00000100:00100000:2.0:1787759188.827912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787759188.827920:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334282880:12345-0@lo:501: 00000100:00100000:1.0:1787759188.827964:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759188.828465:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334282880:12345-0@lo:501: Request processed in 544us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.828475:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787759188.828505:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334282880:0@lo:501: 00000100:00100000:1.0:1787759188.828533:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283008:0@lo:503: 00000100:00100000:0.0:1787759188.830062:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.830091:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.830148:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283008 00000100:00100000:2.0:1787759188.830154:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283008 00000100:00100000:2.0:1787759188.830226:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787759188.830235:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283008:12345-0@lo:503: 00000100:00100000:2.0:1787759188.830499:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283008:12345-0@lo:503: Request processed in 266us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.830508:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787759188.830606:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283008:0@lo:503: 00000040:00080000:0.0:1787759188.830926:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787759188.830989:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283136:0@lo:502: 00000100:00100000:0.0:1787759188.831021:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.831056:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa06410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.831079:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283136 00000100:00100000:1.0:1787759188.831085:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283136 00000100:00100000:1.0:1787759188.831120:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787759188.831128:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283136:12345-0@lo:502: 00000100:00100000:1.0:1787759188.831319:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283136:12345-0@lo:502: Request processed in 191us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.831326:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787759188.831664:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283136:0@lo:502: 00000040:00080000:0.0:1787759188.831983:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787759188.832053:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787759188.832085:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283264:0@lo:502: 00000100:00100000:0.0:1787759188.832123:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.832150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283264 00000100:00100000:0.0:1787759188.832154:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283264 00000100:00100000:0.0:1787759188.832181:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787759188.832187:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283264:12345-0@lo:502: 00000100:00100000:0.0:1787759188.832298:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283264:12345-0@lo:502: Request processed in 110us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759188.832306:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787759188.832348:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa06410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759188.832363:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283264:0@lo:502: 00000040:00080000:0.0:1787759188.832450:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787759188.832461:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787759188.833061:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759188.833071:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759188.833073:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787759188.833078:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fa82f2f000 00000020:00000080:0.0:1787759188.833080:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787759188.833102:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759188.833118:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759188.833120:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787759188.833123:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787759188.833181:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787759188.833207:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787759188.833225:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.833236:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759188.833273:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787759188.833282:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fa82f2f000 10000000:01000000:1.0:1787759188.833285:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fa82f2f000 10000000:01000000:1.0:1787759188.833289:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787759188.833294:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa82f2f000 from 1 10000000:01000000:1.0:1787759188.833297:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787759188.833322:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.833331:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.833341:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759188.833356:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283392:0@lo:101: 00000100:00100000:1.0:1787759188.833390:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.833427:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.834001:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283392 00000100:00100000:2.0:1787759188.834007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283392 00000100:00100000:2.0:1787759188.834059:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787759188.834069:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334283392:12345-0@lo:101: 00010000:00010000:2.0:1787759188.834079:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759188.834091:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de39 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.834112:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de39 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.834131:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de39 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.834140:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151a200, rc 0) 00000100:00100000:2.0:1787759188.834192:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283392:12345-0@lo:101: Request processed in 125us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.834199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787759188.834245:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283392:0@lo:101: 00010000:00010000:0.0:1787759188.834261:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.834272:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.834347:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283520:0@lo:501: 00000100:00100000:0.0:1787759188.834374:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.834400:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa05a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.834432:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283520 00000100:00100000:1.0:1787759188.834438:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283520 00000100:00100000:1.0:1787759188.834470:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787759188.834477:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283520:12345-0@lo:501: 00000100:00100000:1.0:1787759188.834684:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283520:12345-0@lo:501: Request processed in 207us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.834692:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787759188.834745:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283520:0@lo:501: 00000100:00100000:0.0:1787759188.834785:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283648:0@lo:503: 00000100:00100000:0.0:1787759188.834820:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.834837:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa05a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.834881:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283648 00000100:00100000:2.0:1787759188.834886:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283648 00000100:00100000:2.0:1787759188.834914:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787759188.834921:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283648:12345-0@lo:503: 00000100:00100000:2.0:1787759188.835070:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283648:12345-0@lo:503: Request processed in 149us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.835075:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787759188.835099:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283648:0@lo:503: 00000040:00080000:0.0:1787759188.835329:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787759188.835375:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283776:0@lo:502: 00000100:00100000:0.0:1787759188.835409:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.835438:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa06410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759188.835498:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283776 00000100:00100000:1.0:1787759188.835503:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283776 00000100:00100000:1.0:1787759188.835531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787759188.835538:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283776:12345-0@lo:502: 00000100:00100000:0.0:1787759188.835984:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283776:0@lo:502: 00000100:00100000:1.0:1787759188.835988:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283776:12345-0@lo:502: Request processed in 448us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.836004:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:0.0:1787759188.836290:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787759188.836339:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787759188.836386:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787759188.836518:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787759188.836563:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787759188.836609:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787759188.836644:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787759188.836679:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787759188.836738:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787759188.836804:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787759188.836841:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787759188.836884:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787759188.836907:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787759188.836924:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787759188.836962:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787759188.836986:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787759188.837023:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787759188.837078:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787759188.837105:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787759188.837139:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787759188.837186:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787759188.837223:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787759188.837257:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787759188.837305:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787759188.837357:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787759188.837686:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787759188.837744:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787759188.837821:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787759188.837859:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283904:0@lo:502: 00000100:00100000:0.0:1787759188.837916:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.837956:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa06410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.838004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334283904 00000100:00100000:2.0:1787759188.838011:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334283904 00000100:00100000:2.0:1787759188.838069:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787759188.838080:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283904:12345-0@lo:502: 00000100:00100000:2.0:1787759188.838347:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334283904:12345-0@lo:502: Request processed in 268us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759188.838356:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787759188.838382:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334283904:0@lo:502: 00000040:00080000:0.0:1787759188.838458:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787759188.838467:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787759188.839090:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787759188.839117:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98faae4e8000) 00000020:00000080:0.0:1787759188.839136:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787759188.839216:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fa82f2f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787759188.839220:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fa82f2f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787759188.839222:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98fa82f2f000 3 00010000:00080000:0.0:1787759188.839255:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f981da7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.109@tcp at head 00010000:00010000:0.0:1787759188.841221:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787759188.841360:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787759188.841383:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787759188.841391:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xec1488f14640de4e 00000100:00080000:0.0:1787759188.841399:0:6699:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787759188.841403:0:6699:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98f981da7800 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:0.0:1787759188.841428:0:6699:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fa8a384780 x1874601334284032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787759188.841448:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787759188.841490:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601334284032:0@lo:38: 00000100:00100000:2.0:1787759188.841553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.841555:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334284160:0@lo:400: 00000100:00100000:3.0:1787759188.843917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.844066:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284032 00000100:00100000:1.0:1787759188.844074:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284032 00000100:00100000:1.0:1787759188.844101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284160 00000100:00100000:1.0:1787759188.844104:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284160 00000100:00100000:1.0:1787759188.844129:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759188.844140:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334284160:12345-0@lo:400: 00000100:00100000:1.0:1787759188.844214:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334284160:12345-0@lo:400: Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.844223:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759188.844241:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787759188.844246:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874601334284032:12345-0@lo:38: 00010000:00080000:1.0:1787759188.844268:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 95 last 0 00010000:00080000:2.0:1787759188.844297:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fa99cbc780 x1874601334284160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759188.844310:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334284160:0@lo:400: 00000020:00000080:1.0:1787759188.844313:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xec1488f14640de55 00000004:00100000:1.0:1787759188.844328:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787759188.844364:0:5833:0:(import.c:65:import_set_state_nolock()) ffff98fa911c8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787759188.844421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874601334284032:12345-0@lo:38: Request processed in 172us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.844428:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1787759188.844938:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1787759188.845109:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98fa8a384780 x1874601334284032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759188.845119:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787759188.845127:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787759188.845134:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787759188.845139:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787759188.845142:0:3302:0:(import.c:65:import_set_state_nolock()) ffff98f981da7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787759188.845148:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601334284032:0@lo:38: 00000020:01000000:1.0:1787759188.845269:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787759188.845294:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787759188.845355:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759188.845366:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787759188.845423:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787759188.845425:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787759188.845427:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759188.845428:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759188.845429:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759188.845431:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759188.845432:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759188.845434:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759188.845435:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759188.845437:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759188.845438:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787759188.845442:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787759188.845444:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787759188.845446:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787759188.845447:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759188.845449:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759188.845450:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759188.845452:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759188.845453:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759188.845454:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759188.845456:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759188.845458:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759188.845459:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787759188.845480:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787759188.845493:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334284288:0@lo:253: 00000100:00100000:1.0:1787759188.845553:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759188.845588:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.845599:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284288 00000100:00100000:2.0:1787759188.845604:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284288 00000100:00100000:2.0:1787759188.845644:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787759188.845651:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:6674:x1874601334284288:12345-0@lo:253: 20000000:01000000:2.0:1787759188.845677:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787759188.845696:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787759188.858427:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787759188.858446:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787759188.858493:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787759188.858498:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787759188.858521:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.858540:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640ddbb expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.858548:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.858582:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.858594:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 13 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759188.858674:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334284416:0@lo:104: 00000100:00100000:0.0:1787759188.858748:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759188.858839:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15b7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759188.858883:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284416 00000100:00100000:2.0:1787759188.858977:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284416 00000100:00100000:2.0:1787759188.859049:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787759188.859059:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a384b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334284416:12345-0@lo:104: 00010000:00010000:2.0:1787759188.859073:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759188.859138:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787759188.859145:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759188.859153:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759188.859159:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a384b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334284416:12345-0@lo:104: Request processed in 88us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759188.859165:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334284416:0@lo:104: 00000100:00100000:2.0:1787759188.859180:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787759188.859187:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859264:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80031a00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759188.859268:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859285:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759188.859293:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759188.859300:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759188.859339:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859346:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759188.859409:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859418:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640ddbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddc2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859438:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.859441:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.859444:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759188.859452:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334284544:0@lo:103: 00000100:00100000:1.0:1787759188.859487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.859520:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284544 00000100:00100000:3.0:1787759188.859525:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284544 00010000:00010000:3.0:1787759188.859548:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 14 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.859578:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759188.859586:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+14:3304:x1874601334284544:12345-0@lo:103: 00010000:00010000:3.0:1787759188.859597:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759188.859603:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 14 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859620:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 14 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859630:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168f600/0xec1488f14640ddc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640ddbb expref: 14 pid: 5828 timeout: 245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859640:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859645:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787759188.859655:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001596763s 00010000:00010000:3.0:1787759188.859657:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859662:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859667:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859671:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859673:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80030a00 already unused, calling callback (ffffffffc1462530) 00010000:00010000:3.0:1787759188.859676:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859680:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859694:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759188.859701:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759188.859715:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.859727:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759188.859735:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030a00/0xec1488f14640de5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759188.859735:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+13:3304:x1874601334284544:12345-0@lo:103: Request processed in 151us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.859785:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787759188.859789:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334284544:0@lo:103: 00000100:00100000:1.0:1787759188.862548:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:6674:x1874601334284288:12345-0@lo:253: Request processed in 16889us (16988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759188.862561:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787759188.862580:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:6674:1874601334284288:0@lo:253: 10000000:01000000:2.0:1787759188.862602:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787759188.862605:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787759188.862608:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787759188.862609:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759188.862611:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759188.862612:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759188.862613:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759188.862615:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787759188.862617:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759188.862618:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759188.862620:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759188.862621:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787759188.862635:0:6674:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787759188.866403:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759188.866569:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759188.866839:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759188.867011:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759188.867235:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759188.867393:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787759188.868502:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787759188.965169:0:6674:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787759188.965188:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787759188.965241:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787759188.965291:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787759188.965306:0:6674:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787759188.965328:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787759189.165839:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759190.189125:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759191.212950:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759191.519811:0:7042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787759192.236924:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759193.260987:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759194.284988:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759194.349259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334284672:0@lo:400: 00000100:00100000:1.0:1787759194.349354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759194.349476:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284672 00000100:00100000:3.0:1787759194.349487:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284672 00000100:00100000:3.0:1787759194.349545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787759194.349555:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:3305:x1874601334284672:12345-0@lo:400: 00000100:00100000:0.0:1787759194.349576:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334284800:0@lo:400: 00000100:00100000:0.0:1787759194.349622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759194.349665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284800 00000100:00100000:0.0:1787759194.349669:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284800 00000100:00100000:0.0:1787759194.349708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787759194.349714:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334284800:12345-0@lo:400: 00000100:00100000:0.0:1787759194.349794:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334284800:12345-0@lo:400: Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759194.349802:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787759194.349863:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a2d7480 x1874601334284800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759194.349879:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334284800:0@lo:400: 00000100:00100000:3.0:1787759194.350074:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:3305:x1874601334284672:12345-0@lo:400: Request processed in 519us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759194.350082:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787759194.350115:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334284928:0@lo:400: 00000100:00100000:2.0:1787759194.350159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759194.350254:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334284928 00000100:00100000:3.0:1787759194.350259:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334284928 00000100:00100000:3.0:1787759194.350311:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759194.350319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334284928:12345-0@lo:400: 00000100:00100000:3.0:1787759194.350382:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334284928:12345-0@lo:400: Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759194.350390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787759194.350398:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787759194.350448:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a2d6940 x1874601334284928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759194.350472:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334284928:0@lo:400: 00000100:00100000:1.0:1787759194.350597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334284672:0@lo:400: 00010000:00010000:3.0:1787759195.309932:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.332869:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787759196.397006:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787759196.397016:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa851c2800 from 21 10000000:01000000:3.0:1787759196.397033:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759196.397078:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.397090:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.397101:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.397134:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285056:0@lo:101: 00000100:00100000:3.0:1787759196.397208:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.397267:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.397713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285056 00000100:00100000:1.0:1787759196.397722:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285056 00000100:00100000:1.0:1787759196.397811:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787759196.397824:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334285056:12345-0@lo:101: 00010000:00010000:1.0:1787759196.397837:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759196.397852:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de63 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.397877:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de63 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.397901:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de63 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.397911:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168f800, rc 0) 00000100:00100000:1.0:1787759196.397968:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285056:12345-0@lo:101: Request processed in 148us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.397976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787759196.398149:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285056:0@lo:101: 00010000:00010000:2.0:1787759196.398166:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.398177:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.398236:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285184:0@lo:501: 00000100:00100000:2.0:1787759196.398272:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.398377:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.398414:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285184 00000100:00100000:0.0:1787759196.398419:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285184 00000100:00100000:0.0:1787759196.398454:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787759196.398461:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285184:12345-0@lo:501: 00000100:00100000:0.0:1787759196.398978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285184:12345-0@lo:501: Request processed in 517us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.398985:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787759196.399053:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285184:0@lo:501: 00000100:00100000:2.0:1787759196.399089:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285312:0@lo:503: 00000100:00100000:2.0:1787759196.399136:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.399169:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.399191:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285312 00000100:00100000:1.0:1787759196.399197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285312 00000100:00100000:1.0:1787759196.399231:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787759196.399241:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285312:12345-0@lo:503: 00000100:00100000:1.0:1787759196.399980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285312:12345-0@lo:503: Request processed in 739us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.399996:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787759196.400108:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285312:0@lo:503: 00000100:00100000:0.0:1787759196.400499:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7616:1874601334285440:0@lo:502: 00000100:00100000:0.0:1787759196.400546:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.400588:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faa0591600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.400592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285440 00000100:00100000:1.0:1787759196.400597:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285440 00000100:00100000:1.0:1787759196.400632:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787759196.400642:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7616:x1874601334285440:12345-0@lo:502: 00000100:00100000:1.0:1787759196.401130:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7616:x1874601334285440:12345-0@lo:502: Request processed in 490us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.401138:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787759196.401205:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7616:1874601334285440:0@lo:502: 00000100:00100000:0.0:1787759196.401251:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7616:1874601334285568:0@lo:502: 00000100:00100000:0.0:1787759196.401283:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.401332:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285568 00000100:00100000:1.0:1787759196.401336:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285568 00000100:00100000:0.0:1787759196.401343:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43b13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.401399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787759196.401406:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+13:7616:x1874601334285568:12345-0@lo:502: 00000100:00100000:1.0:1787759196.401541:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+13:7616:x1874601334285568:12345-0@lo:502: Request processed in 135us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.401548:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787759196.401571:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7616:1874601334285568:0@lo:502: 00000040:00080000:0.0:1787759196.401589:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787759196.401669:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787759196.401702:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787759196.401711:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.401726:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.401735:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787759196.401774:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98fa851c2800 from 4 10000000:01000000:2.0:1787759196.401777:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787759196.401798:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.401805:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.401811:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.401821:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285696:0@lo:101: 00000100:00100000:2.0:1787759196.401851:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.401876:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.401927:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285696 00000100:00100000:0.0:1787759196.401932:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285696 00000100:00100000:0.0:1787759196.401969:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787759196.401976:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334285696:12345-0@lo:101: 00010000:00010000:0.0:1787759196.401983:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759196.402001:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402021:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de71 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402031:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de71 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402052:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa80031000, rc 0) 00000100:00100000:0.0:1787759196.402098:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334285696:12345-0@lo:101: Request processed in 122us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.402106:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787759196.402123:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285696:0@lo:101: 00010000:00010000:2.0:1787759196.402140:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.402150:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.402203:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285824:0@lo:256: 00000100:00100000:2.0:1787759196.402239:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.402265:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.402314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285824 00000100:00100000:1.0:1787759196.402319:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285824 00000100:00100000:1.0:1787759196.402348:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787759196.402356:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334285824:12345-0@lo:256: 20000000:01000000:1.0:1787759196.402371:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787759196.402387:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787759196.402390:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787759196.402602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334285824:12345-0@lo:256: Request processed in 246us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.402611:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787759196.402633:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285824:0@lo:256: 10000000:01000000:2.0:1787759196.402677:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787759196.402681:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.402703:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.402710:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787759196.402712:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787759196.402713:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787759196.402728:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.402733:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.402738:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.402778:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285952:0@lo:101: 00000100:00100000:2.0:1787759196.402813:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.402840:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.402841:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334285952 00000100:00100000:0.0:1787759196.402845:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334285952 00000100:00100000:0.0:1787759196.402879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787759196.402899:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334285952:12345-0@lo:101: 00010000:00010000:0.0:1787759196.402906:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759196.402918:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640de7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402934:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640de7f expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402943:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de7f expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.402951:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa80031a00, rc 0) 00000100:00100000:0.0:1787759196.402993:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334285952:12345-0@lo:101: Request processed in 106us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.403009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787759196.403020:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334285952:0@lo:101: 00010000:00010000:2.0:1787759196.403035:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.403044:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.403095:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286080:0@lo:501: 00000100:00100000:2.0:1787759196.403126:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.403157:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.403184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286080 00000100:00100000:1.0:1787759196.403190:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286080 00000100:00100000:1.0:1787759196.403227:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787759196.403237:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334286080:12345-0@lo:501: 00000100:00100000:1.0:1787759196.403421:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334286080:12345-0@lo:501: Request processed in 187us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.403429:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787759196.403451:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286080:0@lo:501: 00000100:00100000:2.0:1787759196.403488:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286208:0@lo:503: 00000100:00100000:2.0:1787759196.403529:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.403552:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.403565:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286208 00000100:00100000:1.0:1787759196.403569:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286208 00000100:00100000:1.0:1787759196.403592:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787759196.403601:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334286208:12345-0@lo:503: 00000100:00100000:1.0:1787759196.404024:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334286208:12345-0@lo:503: Request processed in 425us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.404032:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787759196.404053:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286208:0@lo:503: 00000100:00100000:0.0:1787759196.404357:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7617:1874601334286336:0@lo:502: 00000100:00100000:0.0:1787759196.404383:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.404415:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43b1180 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.404419:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286336 00000100:00100000:1.0:1787759196.404423:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286336 00000100:00100000:1.0:1787759196.404450:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787759196.404457:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+15:7617:x1874601334286336:12345-0@lo:502: 00000100:00100000:1.0:1787759196.404612:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+15:7617:x1874601334286336:12345-0@lo:502: Request processed in 156us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.404619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787759196.404633:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a386d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7617:1874601334286336:0@lo:502: 00000020:01000000:0.0:1787759196.404655:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787759196.404661:0:7617:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787759196.404667:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759196.404669:0:7617:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787759196.404673:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787759196.404676:0:7617:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.109@tcp to nid 0x20000c0a8cc6d (192.168.204.109@tcp) 00000020:01000000:0.0:1787759196.404706:0:7617:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787759196.404709:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787759196.404722:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98faae4eced8) 00000020:00000080:0.0:1787759196.404739:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787759196.404744:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787759196.404806:0:7617:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787759196.404810:0:7617:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787759196.404814:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640de94 00010000:00080000:0.0:1787759196.404834:0:7617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98fab43bd800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.109@tcp at head 00010000:00010000:0.0:1787759196.405071:0:7617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787759196.421695:0:7617:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787759196.421713:0:7617:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787759196.422261:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759196.422479:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759196.422525:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787759196.422627:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787759196.423063:0:7619:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787759196.423069:0:7619:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787759196.423580:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759196.423592:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787759196.423645:0:7617:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787759196.423664:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xec1488f14640de9b 00000100:00080000:2.0:1787759196.423674:0:7617:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787759196.423681:0:7617:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98fab43bd800 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:2.0:1787759196.423714:0:7617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fa8a2d6940 x1874601334286464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787759196.423738:0:7617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787759196.423808:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601334286464:0@lo:8: 00000020:01000000:2.0:1787759196.423824:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759196.423830:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.423832:0:7617:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787759196.423836:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759196.423841:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.423843:0:7617:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787759196.423847:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787759196.423849:0:7617:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787759196.423859:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334286720:0@lo:400: 00000100:00100000:3.0:1787759196.423870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601334286592:0@lo:400: 00000100:00100000:2.0:1787759196.423874:0:7617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7617:1874601334286848:0@lo:502: 00000100:00100000:0.0:1787759196.423905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.423927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.423945:0:7617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.423962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.423992:0:7617:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa90342cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.424000:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286464 00000100:00100000:0.0:1787759196.424007:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286464 00000100:00100000:3.0:1787759196.424018:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286720 00000100:00100000:3.0:1787759196.424024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286720 00000100:00100000:2.0:1787759196.424035:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286848 00000100:00100000:2.0:1787759196.424041:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286848 00000100:00100000:0.0:1787759196.424046:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759196.424057:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874601334286464:12345-0@lo:8: 00000100:00100000:3.0:1787759196.424080:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286592 00000100:00100000:3.0:1787759196.424085:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286592 00000100:00100000:2.0:1787759196.424086:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1787759196.424094:0:6676:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 102 last 0 00000100:00100000:2.0:1787759196.424095:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:7617:x1874601334286848:12345-0@lo:502: 00000100:00100000:3.0:1787759196.424122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759196.424131:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334286720:12345-0@lo:400: 00000020:00000080:0.0:1787759196.424133:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xec1488f14640dea2 00002000:00100000:0.0:1787759196.424177:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98fab3e64800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787759196.424183:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787759196.424187:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787759196.424193:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334286720:12345-0@lo:400: Request processed in 62us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.424202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787759196.424210:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbcf00 x1874601334286720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.424222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787759196.424226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334286720:0@lo:400: 00000100:00100000:3.0:1787759196.424234:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601334286592:12345-0@lo:400: 00000100:00100000:3.0:1787759196.424277:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601334286592:12345-0@lo:400: Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.424289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00100000:0.0:1787759196.424322:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1787759196.424331:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbc000 x1874601334286592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.424343:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601334286592:0@lo:400: 00002000:00080000:0.0:1787759196.424552:0:6676:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787759196.424577:0:6676:0:(import.c:65:import_set_state_nolock()) ffff98fab3e62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787759196.424625:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a386d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874601334286464:12345-0@lo:8: Request processed in 569us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.424634:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787759196.424673:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a2d6940 x1874601334286464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787759206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759196.424683:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787759196.424690:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787759196.424697:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787759196.424701:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787759196.424705:0:3302:0:(import.c:65:import_set_state_nolock()) ffff98fab43bd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787759196.424722:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787759196.424729:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601334286464:0@lo:8: 00000004:00080000:3.0:1787759196.424782:0:7619:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1787759196.424798:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759196.424822:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:7617:x1874601334286848:12345-0@lo:502: Request processed in 727us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.424830:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787759196.424896:0:7617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:7617:1874601334286848:0@lo:502: 00000020:01000000:2.0:1787759196.424922:0:7617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759196.424927:0:7617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.424929:0:7617:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787759196.424934:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000004:00080000:3.0:1787759196.424948:0:7619:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 102907196726ns, next at 0ns, rc = 0 00000020:01000000:2.0:1787759196.425381:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787759196.425408:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787759196.425418:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.425429:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.425439:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787759196.425442:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98fa9a7c0000 from 1 10000000:01000000:2.0:1787759196.425446:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787759196.425471:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.425479:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.425488:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.425512:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286976:0@lo:101: 00000100:00100000:2.0:1787759196.425544:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.425569:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.428321:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334286976 00000100:00100000:2.0:1787759196.428335:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334286976 00000100:00100000:2.0:1787759196.428396:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787759196.428410:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334286976:12345-0@lo:101: 00010000:00010000:2.0:1787759196.428427:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759196.428445:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dea9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.428474:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dea9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.428487:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dea9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.428498:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151b200, rc 0) 00000100:00100000:2.0:1787759196.428653:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334286976:12345-0@lo:101: Request processed in 247us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.428663:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787759196.428866:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334286976:0@lo:101: 00010000:00010000:2.0:1787759196.428900:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.428913:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.429003:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334287104:0@lo:501: 00000100:00100000:2.0:1787759196.429047:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.429094:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f9817ea6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.429183:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287104 00000100:00100000:2.0:1787759196.429188:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287104 00000100:00100000:2.0:1787759196.429229:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787759196.429239:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334287104:12345-0@lo:501: 00000100:00100000:2.0:1787759196.429643:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334287104:12345-0@lo:501: Request processed in 405us (597us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759196.429652:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787759196.429702:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334287104:0@lo:501: 10000000:01000000:2.0:1787759196.429818:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787759196.429826:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.429835:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787759196.442265:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787759196.442299:0:7620:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787759196.442305:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759196.442327:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287360:0@lo:7: 00000100:00100000:2.0:1787759196.442327:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334287232:0@lo:13: 00000100:00100000:0.0:1787759196.442397:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.442405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.442440:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287360 00000100:00100000:0.0:1787759196.442447:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43b1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.442447:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287360 00000100:00100000:2.0:1787759196.442512:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287232 00000100:00100000:2.0:1787759196.442518:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287232 00000100:00100000:1.0:1787759196.442526:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759196.442539:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7620:x1874601334287360:12345-0@lo:7: 00000100:00100000:2.0:1787759196.442560:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759196.442570:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874601334287232:12345-0@lo:13: 00002000:00000024:2.0:1787759196.442605:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787759196.442668:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874601334287232:12345-0@lo:13: Request processed in 100us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.442676:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787759196.442736:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a384780 x1874601334287232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.442780:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334287232:0@lo:13: 00000100:00080000:1.0:1787759196.447787:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1787759196.451172:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787759196.451180:0:6678:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787759196.451282:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7620:x1874601334287360:12345-0@lo:7: Request processed in 8744us (8881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.451295:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787759196.451331:0:7620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a384f00 x1874601334287360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759196.451343:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287360:0@lo:7: 00000004:00080000:2.0:1787759196.451358:0:7620:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787759196.451398:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287488:0@lo:5: 00000100:00100000:2.0:1787759196.451434:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.451499:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287488 00000100:00100000:3.0:1787759196.451506:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287488 00000100:00100000:2.0:1787759196.451543:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa9a700e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.451575:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787759196.451587:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7620:x1874601334287488:12345-0@lo:5: 00002000:00080000:1.0:1787759196.451614:0:6676:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787759196.451618:0:6676:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787759196.451746:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787759196.451776:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787759196.451951:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7620:x1874601334287488:12345-0@lo:5: Request processed in 367us (516us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787759196.451961:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787759196.451980:0:7620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a2d4000 x1874601334287488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759196.451989:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287488:0@lo:5: 00000004:00080000:2.0:1787759196.452009:0:7620:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787759196.452036:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287616:0@lo:700: 00000100:00100000:2.0:1787759196.452070:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.452101:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa9a700e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.452285:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287616 00000100:00100000:3.0:1787759196.452289:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287616 00000100:00100000:3.0:1787759196.452379:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759196.452388:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7620:x1874601334287616:12345-0@lo:700: 00000100:00100000:3.0:1787759196.452413:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874601334287744:0@lo:700: 00000100:00100000:3.0:1787759196.452443:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.452461:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.452490:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287744 00000100:00100000:1.0:1787759196.452496:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287744 00000100:00100000:1.0:1787759196.452538:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759196.452548:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874601334287744:12345-0@lo:700: 40000000:02000000:2.0:1787759196.469554:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787759196.475723:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874601334287744:12345-0@lo:700: Request processed in 23171us (23271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.475822:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787759196.475901:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbc000 x1874601334287744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759196.475929:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874601334287744:0@lo:700: 40000000:02000000:2.0:1787759196.475945:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1787759196.508461:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787759196.508482:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1787759196.508525:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7620:x1874601334287616:12345-0@lo:700: Request processed in 56135us (56450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.508560:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787759196.508618:0:7620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a2d6940 x1874601334287616/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759196.508645:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287616:0@lo:700: 00000004:02000040:3.0:1787759196.525515:0:7620:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787759196.531041:0:7620:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287872:0@lo:5: 00000100:00100000:3.0:1787759196.531112:0:7620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.531147:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334287872 00000100:00100000:1.0:1787759196.531156:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334287872 00000100:00100000:3.0:1787759196.531171:0:7620:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.531208:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759196.531218:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7620:x1874601334287872:12345-0@lo:5: 00002000:00080000:1.0:1787759196.537156:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787759196.537179:0:6678:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787759196.541344:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7620:x1874601334287872:12345-0@lo:5: Request processed in 10124us (10229us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787759196.541358:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787759196.541405:0:7620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbc3c0 x1874601334287872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.541426:0:7620:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787759196.541442:0:7620:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98fa99cbc3c0 x1874601334287872/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759212 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.541451:0:7620:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7620:1874601334287872:0@lo:5: 00000004:00080000:3.0:1787759196.541465:0:7620:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000020:01000004:1.0:1787759196.554826:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787759196.554830:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787759196.554974:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98fab41b2800 00000020:01000004:1.0:1787759196.554989:0:7614:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787759196.555000:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787759196.555018:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98fab5179a48) 00000020:00000080:1.0:1787759196.555033:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787759196.563845:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787759196.564128:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787759196.576980:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787759196.580296:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787759196.580326:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787759196.580376:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787759196.580399:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787759196.580781:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787759196.580793:0:7614:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787759196.580803:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xec1488f14640debe 00000020:01000004:1.0:1787759196.580811:0:7614:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787759196.580834:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.109@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787759196.580837:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.109@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787759196.580843:0:7614:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787759196.580865:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787759196.580870:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.109@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787759196.592977:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.109@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787759196.593027:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.109@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787759196.593031:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787759196.593032:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787759196.593033:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759196.593034:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759196.593035:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759196.593036:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759196.593040:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759196.593041:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759196.593042:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759196.593043:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759196.593044:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759196.593047:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787759196.593048:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787759196.593049:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787759196.593050:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759196.593050:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759196.593051:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759196.593052:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759196.593052:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759196.593053:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759196.593054:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759196.593055:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759196.593055:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759196.593086:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787759196.593103:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334288000:0@lo:253: 00000100:00100000:1.0:1787759196.593166:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.593213:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.593240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288000 00000100:00100000:3.0:1787759196.593248:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288000 00000100:00100000:3.0:1787759196.593296:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787759196.593313:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:7614:x1874601334288000:12345-0@lo:253: 20000000:01000000:3.0:1787759196.593346:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787759196.593350:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787759196.593354:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787759196.593356:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787759196.594097:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787759196.594294:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787759196.594308:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787759196.594348:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787759196.594356:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787759196.594385:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787759196.594440:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787759196.594641:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787759196.594658:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.109@tcp 20000000:01000000:3.0:1787759196.594659:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.109@tcp (null) (null) (null) 00000040:00080000:3.0:1787759196.594695:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787759196.594703:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787759196.594772:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787759196.594784:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.109@tcp (null) (null) 00000040:00080000:3.0:1787759196.594827:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787759196.594844:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787759196.594877:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787759196.594938:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787759196.595533:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787759196.595547:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.109@tcp 20000000:01000000:3.0:1787759196.595549:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.109@tcp (null) (null) (null) 00000040:00080000:3.0:1787759196.595599:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787759196.595607:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787759196.595638:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787759196.595645:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.109@tcp (null) (null) 00000040:00080000:3.0:1787759196.595675:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787759196.595683:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787759196.595728:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787759196.595789:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787759196.595805:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787759196.595808:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787759196.595813:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787759196.595815:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787759196.595817:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787759196.595827:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787759196.595830:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787759196.595860:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787759196.595862:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787759196.596523:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787759196.596574:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787759196.596633:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787759196.597204:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787759196.597248:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787759196.597282:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787759196.597295:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787759196.597297:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787759196.597865:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787759196.597936:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787759196.598006:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787759196.598489:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787759196.598529:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787759196.598576:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787759196.598584:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787759196.598586:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787759196.599705:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787759196.599927:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787759196.599972:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787759196.600021:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787759196.600034:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787759196.600036:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787759196.600604:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787759196.600694:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787759196.600730:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787759196.600953:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787759196.601011:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787759196.601082:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1787759196.601164:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787759196.601185:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601199:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de0f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601213:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de39 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601218:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de63 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601234:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601241:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dea9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601248:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601285:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601295:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 16 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.601306:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288128:0@lo:104: 00000100:00100000:2.0:1787759196.601380:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759196.601446:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601455:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.601464:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288256:0@lo:104: 00000100:00100000:3.0:1787759196.601480:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787759196.601499:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.601509:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759196.601513:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 16 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.601523:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288384:0@lo:104: 00000100:00100000:3.0:1787759196.601547:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288128 00000100:00100000:2.0:1787759196.601552:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.601557:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288128 00010000:00010000:2.0:1787759196.601590:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.601595:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288256 00000100:00100000:3.0:1787759196.601600:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288256 00010000:00010000:2.0:1787759196.601601:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.601604:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288384 00000100:00100000:2.0:1787759196.601613:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288512:0@lo:104: 00000100:00100000:3.0:1787759196.601621:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759196.601631:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faa8285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:5828:x1874601334288128:12345-0@lo:104: 00000100:00100000:2.0:1787759196.601640:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759196.601643:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.601662:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288384 00010000:00010000:2.0:1787759196.601668:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.601677:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.601687:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981636d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288640:0@lo:104: 00000100:00100000:1.0:1787759196.601689:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787759196.601698:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787759196.601711:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759196.601719:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.601724:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faa8285050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:5828:x1874601334288128:12345-0@lo:104: Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.601732:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787759196.601733:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.601783:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288128:0@lo:104: 00010000:00010000:0.0:1787759196.601790:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759196.601797:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.601804:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151aa00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:0.0:1787759196.601808:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.601815:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759196.601821:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759196.601825:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759196.601831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288512 00000100:00100000:3.0:1787759196.601836:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288512 00000100:00100000:3.0:1787759196.601851:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288640 00000100:00100000:3.0:1787759196.601854:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288640 00010000:00010000:0.0:1787759196.601857:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.601865:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787759196.601894:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787759196.601903:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334288768:0@lo:103: 00010000:00010000:0.0:1787759196.601906:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.601909:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+6:5828:x1874601334288256:12345-0@lo:104: 00010000:00010000:3.0:1787759196.601924:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.601942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759196.601944:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640dea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640deb0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.601961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.601964:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.601967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759196.602004:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288768 00000100:00100000:2.0:1787759196.602015:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288768 00010000:00010000:3.0:1787759196.602033:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787759196.602034:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.602045:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+6:5828:x1874601334288256:12345-0@lo:104: Request processed in 140us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.602053:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787759196.602066:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787759196.602076:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981636580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+17:3303:x1874601334288768:12345-0@lo:103: 00010000:00010000:1.0:1787759196.602086:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787759196.602087:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787759196.602088:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759196.602092:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.602098:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.602103:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:5828:x1874601334288384:12345-0@lo:104: 00010000:00010000:1.0:1787759196.602107:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151be00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:1.0:1787759196.602113:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602114:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787759196.602119:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.602122:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602129:0:7626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+5:5828:x1874601334288512:12345-0@lo:104: 00010000:00010000:0.0:1787759196.602146:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602149:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.602155:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151b200/0xec1488f14640deb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dea9 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602163:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759196.602171:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:5828:x1874601334288384:12345-0@lo:104: Request processed in 75us (621us total) trans 0 rc 0/0 00010000:00010000:2.0:1787759196.602178:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759196.602179:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 10000000:00010000:1.0:1787759196.602189:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759196.602195:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787759196.602200:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759196.602209:0:7626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+4:5828:x1874601334288512:12345-0@lo:104: Request processed in 84us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.602216:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787759196.602224:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602228:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759196.602229:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:5828:x1874601334288640:12345-0@lo:104: 00000100:00100000:2.0:1787759196.602235:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981636580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+16:3303:x1874601334288768:12345-0@lo:103: Request processed in 158us (292us total) trans 0 rc 0/0 00010000:00010000:1.0:1787759196.602241:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759196.602245:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602248:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787759196.602257:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.602261:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759196.602271:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602272:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151be00/0xec1488f14640de7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de86 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.602292:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c7a00 already unused, calling callback (ffffffffc1a5dc20) 00000100:00100000:2.0:1787759196.602296:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a385680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334288768:0@lo:103: 10000000:00010000:0.0:1787759196.602297:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602297:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787759196.602298:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787759196.602306:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.602309:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:5828:x1874601334288640:12345-0@lo:104: Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.602318:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787759196.602319:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602327:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168e600 already unused, calling callback (ffffffffc1a5dc20) 00000100:00100000:3.0:1787759196.602327:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787759196.602329:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334288896:0@lo:103: 10000000:00010000:1.0:1787759196.602335:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759196.602341:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602348:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602355:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1787759196.602357:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1787759196.602372:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787759196.602384:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787759196.602397:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334288896 00000100:00100000:2.0:1787759196.602402:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334288896 00010000:00010000:2.0:1787759196.602416:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602426:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.602431:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602436:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759196.602443:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759196.602443:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787759196.602462:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602462:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981634780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+16:3303:x1874601334288896:12345-0@lo:103: 00010000:00010000:0.0:1787759196.602463:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602473:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.602477:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759196.602483:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8168e600/0xec1488f14640de39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de40 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.602485:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fac21c7a00/0xec1488f14640de63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de6a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.602486:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.602513:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602517:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.602518:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759196.602523:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.602525:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759196.602528:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.602530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.602531:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759196.602535:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.602544:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334289024:0@lo:103: 00010000:00010000:3.0:1787759196.602546:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c7000 already unused, calling callback (ffffffffc1a5dc20) 00000100:00100000:0.0:1787759196.602551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334289152:0@lo:103: 10000000:00010000:3.0:1787759196.602553:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602562:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981634780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+16:3303:x1874601334288896:12345-0@lo:103: Request processed in 104us (200us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759196.602568:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602571:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:00010000:3.0:1787759196.602583:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.602593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787759196.602594:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759196.602622:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602629:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759196.602631:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334288896:0@lo:103: 00000100:00100000:0.0:1787759196.602637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759196.602645:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602655:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334289280:0@lo:103: 00010000:00010000:3.0:1787759196.602655:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640de0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de16 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602678:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.602681:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.602685:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759196.602689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759196.602693:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.602698:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.602714:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80031a00/0xec1488f14640de86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de7f expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602731:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288256:0@lo:104: 00000100:00100000:2.0:1787759196.602732:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289024 00000100:00100000:3.0:1787759196.602734:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289152 00000100:00100000:2.0:1787759196.602738:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289024 00000100:00100000:3.0:1787759196.602740:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289152 00010000:00010000:2.0:1787759196.602778:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602779:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d5a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288384:0@lo:104: 00010000:00010000:3.0:1787759196.602787:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 16 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.602801:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288512:0@lo:104: 00000100:00100000:2.0:1787759196.602811:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289280 00000100:00100000:2.0:1787759196.602815:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289280 00000100:00100000:3.0:1787759196.602816:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787759196.602818:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981636d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1874601334288640:0@lo:104: 00000100:00100000:1.0:1787759196.602829:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787759196.602835:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 17 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.602835:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+17:3305:x1874601334289024:12345-0@lo:103: 00000100:00100000:1.0:1787759196.602843:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+17:3306:x1874601334289152:12345-0@lo:103: 00010000:00010000:0.0:1787759196.602851:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602851:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759196.602857:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759196.602859:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 17 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602861:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:1.0:1787759196.602864:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.602872:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787759196.602895:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602915:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 17 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602930:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168f800/0xec1488f14640de6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de63 expref: 17 pid: 5828 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.602938:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151a200/0xec1488f14640de40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de39 expref: 16 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.602940:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759196.602954:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787759196.602964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787759196.602972:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816361c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+15:3303:x1874601334289280:12345-0@lo:103: 00000100:00100000:1.0:1787759196.602977:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+15:3306:x1874601334289152:12345-0@lo:103: Request processed in 138us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759196.602979:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759196.602991:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759196.602999:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.603003:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787759196.603017:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.603025:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+14:3305:x1874601334289024:12345-0@lo:103: Request processed in 196us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1787759196.603031:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168e800/0xec1488f14640de16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de0f expref: 14 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.603037:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787759196.603045:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334289152:0@lo:103: 00010000:00010000:2.0:1787759196.603047:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603057:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.603065:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334289024:0@lo:103: 00010000:00010000:2.0:1787759196.603070:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603083:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603091:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603098:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603103:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151ba00 already unused, calling callback (ffffffffc1462530) 00010000:00010000:2.0:1787759196.603107:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603122:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603136:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.603144:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759196.603183:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816361c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+12:3303:x1874601334289280:12345-0@lo:103: Request processed in 212us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.603189:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759196.603227:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334289280:0@lo:103: 00010000:00010000:0.0:1787759196.603230:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.603240:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.603247:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151ba00/0xec1488f14640dec5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787759196.603258:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787759196.618096:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:7614:x1874601334288000:12345-0@lo:253: Request processed in 24783us (24920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.618111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787759196.618188:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334288000:0@lo:253: 10000000:01000000:0.0:1787759196.618203:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787759196.618219:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787759196.618221:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787759196.618222:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759196.618224:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787759196.618225:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759196.618226:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759196.618227:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787759196.618229:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787759196.618230:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759196.618231:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787759196.618253:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98fab41b2800 from lustre-OST0001 10000000:01000000:0.0:1787759196.618276:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787759196.618279:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787759196.618286:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98fa9a7c0000 local copy 10000000:01000000:0.0:1787759196.618290:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759196.618323:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.618334:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.618375:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.618392:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a3870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289408:0@lo:101: 00000100:00100000:0.0:1787759196.618426:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.618458:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae49a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.618478:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289408 00000100:00100000:2.0:1787759196.618484:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289408 00000100:00100000:2.0:1787759196.618532:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787759196.618540:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:7614:x1874601334289408:12345-0@lo:101: 00010000:00010000:2.0:1787759196.618550:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759196.618567:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151b200/0xec1488f14640ded3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640decc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.618589:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151b200/0xec1488f14640ded3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640decc expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.618601:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151b200/0xec1488f14640ded3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640decc expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.618608:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151b200, rc 0) 00000100:00100000:2.0:1787759196.618641:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289408:12345-0@lo:101: Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.618646:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787759196.618781:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a3870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289408:0@lo:101: 00010000:00010000:1.0:1787759196.618794:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.618804:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.618918:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289536:0@lo:501: 00000100:00100000:1.0:1787759196.618944:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.618969:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360900 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.619119:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289536 00000100:00100000:0.0:1787759196.619124:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289536 00000100:00100000:0.0:1787759196.619153:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787759196.619160:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289536:12345-0@lo:501: 00000100:00100000:0.0:1787759196.619390:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289536:12345-0@lo:501: Request processed in 231us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787759196.619396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787759196.619434:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289536:0@lo:501: 10000000:01000000:1.0:1787759196.619445:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.109@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787759196.619471:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.109@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787759196.619477:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619486:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619492:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619520:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787759196.619539:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98fab41b2800 00010000:00010000:3.0:1787759196.619541:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787759196.619545:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787759196.619550:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759196.619551:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787759196.619555:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787759196.619562:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787759196.619566:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787759196.619566:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80031a00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759196.619571:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.619578:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619585:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619595:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759196.619596:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.619613:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759196.619613:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787759196.619628:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289664:0@lo:101: 00010000:00010000:3.0:1787759196.619637:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.619656:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759196.619657:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759196.619693:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.619701:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa80031a00/0xec1488f14640decc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xec1488f14640ded3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.619714:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360240 going to sleep for 11 seconds 00010000:00010000:3.0:1787759196.619715:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.619718:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.619722:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759196.619731:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759196.619744:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334289792:0@lo:103: 00000100:00100000:0.0:1787759196.619776:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289664 00000100:00100000:0.0:1787759196.619781:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289664 00000100:00100000:0.0:1787759196.619807:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787759196.619818:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289664:12345-0@lo:101: 00000100:00100000:3.0:1787759196.619821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759196.619829:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759196.619841:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640deda expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.619858:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640deda expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.619869:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640deda expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.619876:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa80030a00, rc 0) 00000100:00100000:1.0:1787759196.619927:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289792 00000100:00100000:1.0:1787759196.619932:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289792 00000100:00100000:1.0:1787759196.619965:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759196.619972:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+14:3303:x1874601334289792:12345-0@lo:103: 00010000:00010000:1.0:1787759196.619981:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759196.619993:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151b200/0xec1488f14640ded3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xec1488f14640decc expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.620003:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787759196.620043:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+13:3303:x1874601334289792:12345-0@lo:103: Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.620050:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759196.620075:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334289792:0@lo:103: 00000100:00100000:0.0:1787759196.620162:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289664:12345-0@lo:101: Request processed in 347us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.620168:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787759196.620215:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289664:0@lo:101: 00010000:00010000:1.0:1787759196.620226:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.620235:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.620287:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289920:0@lo:501: 00000100:00100000:1.0:1787759196.620311:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.620358:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360240 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.620386:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334289920 00000100:00100000:0.0:1787759196.620391:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334289920 00000100:00100000:0.0:1787759196.620415:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787759196.620421:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289920:12345-0@lo:501: 00000100:00100000:0.0:1787759196.620574:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334289920:12345-0@lo:501: Request processed in 151us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.620582:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787759196.620597:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334289920:0@lo:501: 00000100:00100000:1.0:1787759196.620623:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290048:0@lo:503: 00000100:00100000:1.0:1787759196.620661:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.620680:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360240 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.620693:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290048 00000100:00100000:0.0:1787759196.620698:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290048 00000100:00100000:0.0:1787759196.620728:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787759196.620735:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290048:12345-0@lo:503: 00000100:00100000:0.0:1787759196.620905:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290048:12345-0@lo:503: Request processed in 170us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.620910:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787759196.620932:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290048:0@lo:503: 00000040:00080000:1.0:1787759196.621184:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787759196.621260:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290176:0@lo:502: 00000100:00100000:1.0:1787759196.621293:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.621329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290176 00000100:00100000:0.0:1787759196.621334:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290176 00000100:00100000:1.0:1787759196.621335:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360240 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.621367:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787759196.621374:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290176:12345-0@lo:502: 00000100:00100000:0.0:1787759196.621510:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290176:12345-0@lo:502: Request processed in 135us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.621517:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787759196.621564:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290176:0@lo:502: 00000040:00080000:1.0:1787759196.621869:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787759196.621925:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787759196.621945:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787759196.622004:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787759196.622044:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787759196.622083:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787759196.622106:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290304:0@lo:502: 00000100:00100000:1.0:1787759196.622143:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.622172:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4360240 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.622187:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290304 00000100:00100000:0.0:1787759196.622192:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290304 00000100:00100000:0.0:1787759196.622222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787759196.622230:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290304:12345-0@lo:502: 00000100:00100000:0.0:1787759196.622375:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290304:12345-0@lo:502: Request processed in 146us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.622381:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787759196.622402:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290304:0@lo:502: 00000040:00080000:1.0:1787759196.622489:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787759196.622497:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787759196.622931:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787759196.622938:0:7629:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787759196.622944:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759196.622947:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787759196.622951:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787759196.622964:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98fab517b490) 00000020:00000080:1.0:1787759196.622982:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787759196.622987:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787759196.623049:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fab41b2800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787759196.623056:0:7629:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787759196.623063:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xec1488f14640deef 00010000:00010000:1.0:1787759196.625823:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787759196.626080:0:7629:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787759196.628193:0:7629:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787759196.628396:0:7629:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787759196.631722:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787759196.632339:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787759196.633634:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787759196.633646:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759196.633653:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.633655:0:7629:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787759196.633659:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759196.633664:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.633665:0:7629:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787759196.633670:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787759196.633672:0:7629:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787759196.633714:0:7629:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759196.633718:0:7629:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759196.633719:0:7629:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787759196.633723:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787759196.633896:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787759196.633919:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787759196.633944:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.633955:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759196.633963:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fab41b2800 from 1 10000000:01000000:3.0:1787759196.633966:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759196.634010:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.634018:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.634033:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.634052:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290432:0@lo:101: 00000100:00100000:3.0:1787759196.634190:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.634238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290432 00000100:00100000:3.0:1787759196.634239:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.634246:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290432 00000100:00100000:0.0:1787759196.634288:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787759196.634298:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:7614:x1874601334290432:12345-0@lo:101: 00010000:00010000:0.0:1787759196.634310:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759196.634323:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640def6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.634345:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640def6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.634356:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640def6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.634365:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa80030800, rc 0) 00000100:00100000:0.0:1787759196.634408:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290432:12345-0@lo:101: Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.634415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787759196.634459:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290432:0@lo:101: 00010000:00010000:3.0:1787759196.634474:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.634484:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.634575:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290560:0@lo:501: 00000100:00100000:3.0:1787759196.634604:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.634635:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.634657:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290560 00000100:00100000:2.0:1787759196.634663:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290560 00000100:00100000:2.0:1787759196.634696:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787759196.634703:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290560:12345-0@lo:501: 00000100:00100000:2.0:1787759196.634944:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290560:12345-0@lo:501: Request processed in 240us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.634951:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787759196.634985:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290560:0@lo:501: 00000100:00100000:3.0:1787759196.635032:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290688:0@lo:503: 00000100:00100000:3.0:1787759196.635073:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.635100:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.635119:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290688 00000100:00100000:1.0:1787759196.635126:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290688 00000100:00100000:1.0:1787759196.635160:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787759196.635169:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290688:12345-0@lo:503: 00000100:00100000:1.0:1787759196.635508:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290688:12345-0@lo:503: Request processed in 339us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.635516:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787759196.635559:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290688:0@lo:503: 00000040:00080000:3.0:1787759196.635841:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787759196.635923:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290816:0@lo:502: 00000100:00100000:3.0:1787759196.635959:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.635992:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.635995:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290816 00000100:00100000:2.0:1787759196.636001:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290816 00000100:00100000:2.0:1787759196.636034:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787759196.636045:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290816:12345-0@lo:502: 00000100:00100000:2.0:1787759196.636217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290816:12345-0@lo:502: Request processed in 175us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.636225:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787759196.636249:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290816:0@lo:502: 00000040:00080000:3.0:1787759196.636498:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787759196.636552:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787759196.636578:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290944:0@lo:502: 00000100:00100000:3.0:1787759196.636614:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.636644:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.636669:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334290944 00000100:00100000:2.0:1787759196.636674:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334290944 00000100:00100000:2.0:1787759196.636701:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787759196.636708:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290944:12345-0@lo:502: 00000100:00100000:2.0:1787759196.636923:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334290944:12345-0@lo:502: Request processed in 215us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.636931:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787759196.636967:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334290944:0@lo:502: 00000040:00080000:3.0:1787759196.637056:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787759196.637066:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787759196.637527:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759196.637534:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759196.637536:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787759196.637541:0:7633:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fab41b2800 00000020:00000080:3.0:1787759196.637543:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787759196.637563:0:7633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759196.637565:0:7633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759196.637566:0:7633:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787759196.637569:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787759196.637624:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787759196.637652:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759196.637669:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.637679:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.637722:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787759196.637725:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98fab41b2800 10000000:01000000:2.0:1787759196.637728:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98fab41b2800 10000000:01000000:2.0:1787759196.637732:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787759196.637738:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fab41b2800 from 1 10000000:01000000:2.0:1787759196.637741:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787759196.637788:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.637796:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.637804:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.637818:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291072:0@lo:101: 00000100:00100000:2.0:1787759196.637854:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759196.637891:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291072 00000100:00100000:3.0:1787759196.637897:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291072 00000100:00100000:2.0:1787759196.637905:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.637938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787759196.637948:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334291072:12345-0@lo:101: 00010000:00010000:3.0:1787759196.637958:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759196.637970:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df04 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.637989:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df04 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.638001:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df04 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.638012:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6400, rc 0) 00000100:00100000:3.0:1787759196.638049:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291072:12345-0@lo:101: Request processed in 103us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.638056:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787759196.638078:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291072:0@lo:101: 00010000:00010000:2.0:1787759196.638093:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.638102:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.638173:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291200:0@lo:501: 00000100:00100000:2.0:1787759196.638202:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.638220:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.638224:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291200 00000100:00100000:3.0:1787759196.638229:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291200 00000100:00100000:3.0:1787759196.638262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787759196.638271:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291200:12345-0@lo:501: 00000100:00100000:3.0:1787759196.638443:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291200:12345-0@lo:501: Request processed in 173us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.638450:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787759196.638494:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291200:0@lo:501: 00000100:00100000:2.0:1787759196.638519:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291328:0@lo:503: 00000100:00100000:2.0:1787759196.638557:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.638572:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.638579:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291328 00000100:00100000:3.0:1787759196.638585:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291328 00000100:00100000:3.0:1787759196.638605:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787759196.638609:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291328:12345-0@lo:503: 00000100:00100000:3.0:1787759196.638727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291328:12345-0@lo:503: Request processed in 116us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.638734:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787759196.638782:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291328:0@lo:503: 00000040:00080000:2.0:1787759196.638994:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787759196.639035:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291456:0@lo:502: 00000100:00100000:2.0:1787759196.639067:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.639101:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.639114:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291456 00000100:00100000:3.0:1787759196.639119:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291456 00000100:00100000:3.0:1787759196.639146:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787759196.639153:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291456:12345-0@lo:502: 00000100:00100000:3.0:1787759196.639295:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291456:12345-0@lo:502: Request processed in 142us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.639303:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787759196.639323:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291456:0@lo:502: 00000040:00080000:2.0:1787759196.639549:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787759196.639593:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787759196.639621:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787759196.639659:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787759196.639688:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787759196.639738:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787759196.639894:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787759196.639940:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787759196.639988:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787759196.640018:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787759196.640045:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787759196.640095:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787759196.640126:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787759196.640154:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787759196.640192:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787759196.640230:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787759196.640259:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787759196.640298:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787759196.640327:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787759196.640356:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787759196.640394:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787759196.640422:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787759196.640449:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787759196.640487:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787759196.640516:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787759196.640544:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787759196.640582:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787759196.640613:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787759196.640641:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787759196.640694:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787759196.640724:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787759196.640785:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787759196.640820:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787759196.640859:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787759196.640902:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787759196.640947:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787759196.640979:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787759196.641008:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291584:0@lo:502: 00000100:00100000:2.0:1787759196.641052:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.641090:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759196.641110:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291584 00000100:00100000:3.0:1787759196.641125:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291584 00000100:00100000:3.0:1787759196.641162:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787759196.641170:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291584:12345-0@lo:502: 00000100:00100000:3.0:1787759196.641336:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334291584:12345-0@lo:502: Request processed in 167us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.641344:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787759196.641364:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981635e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334291584:0@lo:502: 00000040:00080000:2.0:1787759196.641423:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787759196.641431:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787759196.641944:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787759196.641958:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98faae4e9a48) 00000020:00000080:0.0:1787759196.641977:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787759196.642179:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98fab41b2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787759196.642184:0:7634:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98fab41b2800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787759196.642186:0:7634:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98fab41b2800 3 00010000:00080000:0.0:1787759196.642213:0:7634:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f98268d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.109@tcp at head 00010000:00010000:0.0:1787759196.644238:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787759196.644448:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787759196.644479:0:7634:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787759196.644491:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xec1488f14640df19 00000100:00080000:0.0:1787759196.644501:0:7634:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787759196.644506:0:7634:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98f98268d800 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:0.0:1787759196.644540:0:7634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98fa8a384b40 x1874601334291712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787759196.644566:0:7634:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787759196.644593:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601334291712:0@lo:38: 00000100:00100000:3.0:1787759196.644677:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601334291968:0@lo:400: 00000100:00100000:2.0:1787759196.644680:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.644688:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334291840:0@lo:400: 00000100:00100000:3.0:1787759196.644735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.644789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291712 00000100:00100000:2.0:1787759196.644796:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291712 00000100:00100000:3.0:1787759196.644818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291968 00000100:00100000:3.0:1787759196.644824:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291968 00000100:00100000:2.0:1787759196.644829:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759196.644838:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1874601334291712:12345-0@lo:38: 00000100:00100000:3.0:1787759196.644863:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:2.0:1787759196.644867:0:5834:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000100:00100000:3.0:1787759196.644873:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787759196.644910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787759196.644914:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:00000080:2.0:1787759196.644915:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xec1488f14640df20 00000004:00100000:2.0:1787759196.644934:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787759196.644970:0:5834:0:(import.c:65:import_set_state_nolock()) ffff98f981d12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759196.645006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334291840 00000100:00100000:3.0:1787759196.645011:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334291840 00000100:00100000:2.0:1787759196.645030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981635e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874601334291712:12345-0@lo:38: Request processed in 186us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.645032:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787759196.645042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787759196.645149:0:7635:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff98fa8a384f00 x1874601334292096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.645158:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787759196.645164:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac1701c00 going to sleep for 0 seconds 00000100:00100000:3.0:1787759196.645173:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601334291968:12345-0@lo:400: 00000100:00100000:2.0:1787759196.645188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787759196.645199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334291840:12345-0@lo:400: 00000100:00100000:3.0:1787759196.645227:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601334291968:12345-0@lo:400: Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.645235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787759196.645257:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334291840:12345-0@lo:400: Request processed in 60us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.645264:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787759196.645303:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbcb40 x1874601334291840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787759196.645319:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa99cbe1c0 x1874601334291968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759196.645350:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601334291968:0@lo:400: 00000100:00100000:2.0:1787759196.645351:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334291840:0@lo:400: 00000020:01000000:3.0:1787759196.645369:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00010000:00080000:2.0:1787759196.645394:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a384b40 x1874601334291712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787759196.645400:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1787759196.645412:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787759196.645418:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00010000:00010000:3.0:1787759196.645421:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787759196.645424:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787759196.645431:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00010000:00010000:3.0:1787759196.645436:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787759196.645437:0:3302:0:(import.c:65:import_set_state_nolock()) ffff98f98268d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787759196.645447:0:3302:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000009fc7c66): req@ffff98fa8a384f00 x1874601334292096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759196.645474:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601334291712:0@lo:38: 00000020:01000004:3.0:1787759196.645507:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787759196.645510:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759196.645512:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759196.645513:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759196.645515:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759196.645517:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759196.645520:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759196.645522:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759196.645525:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759196.645529:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1787759196.645530:0:7635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787759196.645533:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787759196.645537:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787759196.645540:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787759196.645541:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759196.645542:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759196.645543:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759196.645544:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759196.645546:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759196.645548:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759196.645550:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759196.645551:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759196.645553:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759196.645555:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787759196.645559:0:7635:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac1701c00 going to sleep for 11 seconds 10000000:01000000:3.0:1787759196.645583:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787759196.645594:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334292224:0@lo:253: 00000100:00100000:2.0:1787759196.645641:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292096 00000100:00100000:3.0:1787759196.645646:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.645647:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292096 00000100:00100000:3.0:1787759196.645685:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae28b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787759196.645697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759196.645699:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292224 00000100:00100000:0.0:1787759196.645705:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292224 00000100:00100000:2.0:1787759196.645709:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1874601334292096:12345-0@lo:901: 00000100:00080000:3.0:1787759196.645721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759196.645746:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787759196.645782:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:7614:x1874601334292224:12345-0@lo:253: 20000000:01000000:0.0:1787759196.645815:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787759196.645829:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787759196.646059:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7635:x1874601334292096:12345-0@lo:901: Request processed in 353us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.646067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787759196.646109:0:7635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98fa8a384f00 x1874601334292096/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787759212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759196.646121:0:7635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7635:1874601334292096:0@lo:901: 20000000:01000000:1.0:1787759196.657582:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787759196.657597:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787759196.657625:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787759196.657632:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787759196.657654:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.657682:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de71 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.657691:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.657728:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.657827:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 14 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.657844:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334292352:0@lo:104: 00000100:00100000:0.0:1787759196.657932:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.657980:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa86d29480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759196.657981:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292352 00000100:00100000:1.0:1787759196.657990:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292352 00000100:00100000:1.0:1787759196.658050:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787759196.658059:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334292352:12345-0@lo:104: 00010000:00010000:1.0:1787759196.658072:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.658160:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787759196.658167:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+3:5849:x1874601334292352:12345-0@lo:104: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.658175:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787759196.658188:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759196.658197:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.658214:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a387480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874601334292352:0@lo:104: 00010000:00010000:2.0:1787759196.658221:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151b800 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:2.0:1787759196.658226:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658234:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.658237:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759196.658253:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.658267:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787759196.658303:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.658309:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759196.658330:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.658337:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151b800/0xec1488f14640de71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de78 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.658337:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981637840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334292480:0@lo:103: 00010000:00010000:2.0:1787759196.658356:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.658357:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.658360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759196.658371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759196.658408:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292480 00000100:00100000:0.0:1787759196.658414:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292480 00010000:00010000:0.0:1787759196.658432:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.658458:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787759196.658465:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+15:3303:x1874601334292480:12345-0@lo:103: 00010000:00010000:0.0:1787759196.658477:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759196.658482:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658500:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658515:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80031000/0xec1488f14640de78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de71 expref: 15 pid: 5827 timeout: 253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658529:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658538:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787759196.658550:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001596763s 00010000:00010000:0.0:1787759196.658555:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658563:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658571:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658579:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658586:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80031c00 already unused, calling callback (ffffffffc1462530) 00010000:00010000:0.0:1787759196.658591:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658599:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658630:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.658641:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759196.658679:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+14:3303:x1874601334292480:12345-0@lo:103: Request processed in 214us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.658688:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787759196.658831:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.658841:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.658848:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80031c00/0xec1488f14640df27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.658925:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981637840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334292480:0@lo:103: 00000100:00100000:1.0:1787759196.660237:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:7614:x1874601334292224:12345-0@lo:253: Request processed in 14456us (14592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.660251:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787759196.660267:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:654ae17d-b69d-436d-8406-f726a2563564:7614:1874601334292224:0@lo:253: 10000000:01000000:3.0:1787759196.660283:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787759196.660286:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759196.660288:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759196.660294:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759196.660296:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759196.660297:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759196.660298:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759196.660300:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759196.660302:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759196.660303:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759196.660304:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759196.660306:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787759196.660319:0:7614:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787759196.664096:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759196.664226:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787759196.664368:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759196.664496:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787759196.664702:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759196.664894:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787759196.665519:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787759196.747657:0:7614:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787759196.747665:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787759196.747724:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787759196.747804:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.109@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787759196.747820:0:7614:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787759196.747838:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787759197.358006:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759198.381915:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759199.042616:0:7977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787759199.405901:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759200.429042:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759201.452904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759201.518412:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787759201.518443:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334292608:0@lo:13: 00000100:00100000:0.0:1787759201.518516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759201.518550:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292608 00000100:00100000:2.0:1787759201.518559:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292608 00000100:00100000:2.0:1787759201.518636:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759201.518647:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334292608:12345-0@lo:13: 00002000:00000024:2.0:1787759201.518682:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759201.518775:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334292608:12345-0@lo:13: Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759201.518784:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787759201.518818:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa8a3852c0 x1874601334292608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759201.518839:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334292608:0@lo:13: 00000100:00080000:1.0:1787759201.519233:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787759201.545779:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1787759201.852526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759201.852631:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839040 00000100:00100000:1.0:1787759201.852641:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839040 00000100:00100000:0.0:1787759201.852724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 83 00000100:00100000:0.0:1787759201.852734:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1874601324839040:12345-192.168.204.9@tcp:250: 00010000:00080000:0.0:1787759201.852794:0:5827:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 7004f5ce-d88c-4df1-9ee2-efe47130d121@192.168.204.9@tcp t0 exp 0000000000000000 cur 108 last 0 00000020:00000080:0.0:1787759201.852821:0:5827:0:(genops.c:1385:class_connect()) connect: client 7004f5ce-d88c-4df1-9ee2-efe47130d121, cookie 0xec1488f14640df2e 00000100:00080000:0.0:1787759201.852982:0:5827:0:(import.c:65:import_set_state_nolock()) ffff98f982688000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787759201.853041:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+5:2345:x1874601324839040:12345-192.168.204.9@tcp:250: Request processed in 306us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.853055:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 83 00000100:00100000:0.0:1787759201.857663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759201.857743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839168 00000100:00100000:3.0:1787759201.857771:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839168 00000100:00100000:3.0:1787759201.857829:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 84 00000100:00100000:3.0:1787759201.857849:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+5:5567:x1874601324839168:12345-192.168.204.9@tcp:101: 00010000:00010000:3.0:1787759201.857865:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759201.857882:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef616a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.857913:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.857935:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.857944:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6200, rc 0) 00000100:00100000:3.0:1787759201.857990:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+6:5567:x1874601324839168:12345-192.168.204.9@tcp:101: Request processed in 152us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759201.857998:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 84 00000100:00100000:1.0:1787759201.862603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.862718:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839296 00000100:00100000:0.0:1787759201.862736:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839296 00000100:00100000:0.0:1787759201.862825:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 85 00000100:00100000:0.0:1787759201.862845:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+6:5567:x1874601324839296:12345-192.168.204.9@tcp:501: 00000100:00100000:0.0:1787759201.863306:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+6:5567:x1874601324839296:12345-192.168.204.9@tcp:501: Request processed in 471us (713us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787759201.863315:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 85 00000100:00100000:0.0:1787759201.864457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759201.864502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839424 00000100:00100000:3.0:1787759201.864509:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839424 00000100:00100000:3.0:1787759201.864558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 86 00000100:00100000:3.0:1787759201.864569:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+6:5567:x1874601324839424:12345-192.168.204.9@tcp:101: 00010000:00010000:3.0:1787759201.864582:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759201.864598:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef6171 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.864624:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.864643:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759201.864653:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c7a00, rc 0) 00000100:00100000:3.0:1787759201.864691:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+7:5567:x1874601324839424:12345-192.168.204.9@tcp:101: Request processed in 124us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759201.864698:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 86 00000100:00100000:1.0:1787759201.865852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.865921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839552 00000100:00100000:0.0:1787759201.865926:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839552 00000100:00100000:0.0:1787759201.865994:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 87 00000100:00100000:0.0:1787759201.866013:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+7:5567:x1874601324839552:12345-192.168.204.9@tcp:501: 00000100:00100000:0.0:1787759201.866233:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5567:x1874601324839552:12345-192.168.204.9@tcp:501: Request processed in 221us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.866241:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 87 00000100:00100000:1.0:1787759201.868147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759201.868240:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839680 00000100:00100000:3.0:1787759201.868246:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839680 00000100:00100000:1.0:1787759201.868334:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 88 00000100:00100000:1.0:1787759201.868348:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5567:x1874601324839680:12345-192.168.204.9@tcp:503: 00000100:00100000:1.0:1787759201.868634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5567:x1874601324839680:12345-192.168.204.9@tcp:503: Request processed in 291us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.868642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 88 00000100:00100000:3.0:1787759201.871314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759201.871374:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839808 00000100:00100000:1.0:1787759201.871382:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839808 00000100:00100000:1.0:1787759201.871446:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 89 00000100:00100000:1.0:1787759201.871459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5585:x1874601324839808:12345-192.168.204.9@tcp:502: 00000100:00100000:1.0:1787759201.871988:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5585:x1874601324839808:12345-192.168.204.9@tcp:502: Request processed in 532us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.872009:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 89 00000100:00100000:1.0:1787759201.880960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.881161:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324839936 00000100:00100000:0.0:1787759201.881171:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324839936 00000100:00100000:0.0:1787759201.881225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 90 00000100:00100000:0.0:1787759201.881236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5585:x1874601324839936:12345-192.168.204.9@tcp:502: 00000100:00100000:0.0:1787759201.881482:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5585:x1874601324839936:12345-192.168.204.9@tcp:502: Request processed in 246us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.881492:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 90 00000100:00100000:0.0:1787759201.883284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759201.883369:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840064 00000100:00100000:1.0:1787759201.883378:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840064 00000100:00100000:1.0:1787759201.883417:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 91 00000100:00100000:1.0:1787759201.883429:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5567:x1874601324840064:12345-192.168.204.9@tcp:101: 00010000:00010000:1.0:1787759201.883464:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759201.883482:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168fe00/0xec1488f14640df43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef619b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759201.883508:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168fe00/0xec1488f14640df43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef619b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759201.883529:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168fe00/0xec1488f14640df43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef619b expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759201.883538:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168fe00, rc 0) 00000100:00100000:1.0:1787759201.883583:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5567:x1874601324840064:12345-192.168.204.9@tcp:101: Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.883590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 91 00000100:00100000:1.0:1787759201.887567:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.887640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840192 00000100:00100000:0.0:1787759201.887647:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840192 00000100:00100000:0.0:1787759201.887685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 92 00000100:00100000:0.0:1787759201.887692:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5567:x1874601324840192:12345-192.168.204.9@tcp:256: 20000000:01000000:0.0:1787759201.887718:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787759201.887731:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787759201.887733:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787759201.887735:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787759201.887736:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787759201.888705:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5567:x1874601324840192:12345-192.168.204.9@tcp:256: Request processed in 1010us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759201.888714:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 92 00000100:00100000:1.0:1787759201.891074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.891142:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840320 00000100:00100000:0.0:1787759201.891151:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840320 00000100:00100000:0.0:1787759201.891201:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 93 00000100:00100000:0.0:1787759201.891213:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5567:x1874601324840320:12345-192.168.204.9@tcp:101: 00010000:00010000:0.0:1787759201.891228:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759201.891245:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef61a2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759201.891271:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759201.891282:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759201.891291:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa80031a00, rc 0) 00000100:00100000:0.0:1787759201.891341:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5567:x1874601324840320:12345-192.168.204.9@tcp:101: Request processed in 131us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.891349:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 93 00000100:00100000:1.0:1787759201.892356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759201.892480:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840448 00000100:00100000:2.0:1787759201.892485:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840448 00000100:00100000:2.0:1787759201.892515:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 94 00000100:00100000:2.0:1787759201.892523:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5567:x1874601324840448:12345-192.168.204.9@tcp:501: 00000100:00100000:2.0:1787759201.892715:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5567:x1874601324840448:12345-192.168.204.9@tcp:501: Request processed in 192us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759201.892724:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 94 00000100:00100000:1.0:1787759201.894517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.894705:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840576 00000100:00100000:0.0:1787759201.894713:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840576 00000100:00100000:0.0:1787759201.894796:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 95 00000100:00100000:0.0:1787759201.894806:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5567:x1874601324840576:12345-192.168.204.9@tcp:503: 00000100:00100000:0.0:1787759201.895166:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5567:x1874601324840576:12345-192.168.204.9@tcp:503: Request processed in 360us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.895182:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 95 00000100:00100000:1.0:1787759201.896844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759201.896891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840704 00000100:00100000:2.0:1787759201.896899:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840704 00000100:00100000:2.0:1787759201.896947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 96 00000100:00100000:2.0:1787759201.896959:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5589:x1874601324840704:12345-192.168.204.9@tcp:502: 00000100:00100000:2.0:1787759201.897195:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5589:x1874601324840704:12345-192.168.204.9@tcp:502: Request processed in 240us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759201.897203:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 96 00000100:00100000:1.0:1787759201.899942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759201.899971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840832 00000100:00100000:0.0:1787759201.899980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840832 00000100:00100000:0.0:1787759201.900025:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 97 00000100:00100000:0.0:1787759201.900067:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5589:x1874601324840832:12345-192.168.204.9@tcp:502: 00000100:00100000:0.0:1787759201.900380:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5589:x1874601324840832:12345-192.168.204.9@tcp:502: Request processed in 317us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759201.900390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 97 00000100:00100000:1.0:1787759201.902023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759201.902289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324840960 00000100:00100000:2.0:1787759201.902296:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324840960 00000100:00100000:2.0:1787759201.902332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 4 00000100:00100000:2.0:1787759201.902339:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1874601324840960:12345-192.168.204.9@tcp:38: 00010000:00080000:2.0:1787759201.902363:0:5835:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 6adecffe-4523-438b-8da7-1d705d9fa828@192.168.204.9@tcp t0 exp 0000000000000000 cur 108 last 0 00000020:00000080:2.0:1787759201.902431:0:5835:0:(genops.c:1385:class_connect()) connect: client 6adecffe-4523-438b-8da7-1d705d9fa828, cookie 0xec1488f14640df51 00000004:00100000:2.0:1787759201.902459:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787759201.902465:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787759201.919951:0:5835:0:(import.c:65:import_set_state_nolock()) ffff98f98321e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787759201.920039:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adecffe-4523-438b-8da7-1d705d9fa828+6:2345:x1874601324840960:12345-192.168.204.9@tcp:38: Request processed in 17697us (18017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.920052:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 4 00000100:00100000:2.0:1787759202.029055:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334292736:0@lo:400: 00000100:00100000:0.0:1787759202.029082:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334292864:0@lo:400: 00000100:00100000:3.0:1787759202.029082:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601334293120:0@lo:400: 00000100:00100000:1.0:1787759202.029095:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334292992:0@lo:400: 00000100:00100000:2.0:1787759202.029179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.029200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.029242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292736 00000100:00100000:1.0:1787759202.029253:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292736 00000100:00100000:0.0:1787759202.029262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293120 00000100:00100000:0.0:1787759202.029270:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293120 00000100:00100000:2.0:1787759202.029309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.029336:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787759202.029336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759202.029357:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:3305:x1874601334292736:12345-0@lo:400: 00000100:00100000:3.0:1787759202.029360:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292992 00000100:00100000:0.0:1787759202.029366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759202.029368:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292992 00000100:00100000:0.0:1787759202.029381:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601334293120:12345-0@lo:400: 00000100:00100000:3.0:1787759202.029419:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787759202.029432:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334292992:12345-0@lo:400: 00000100:00100000:1.0:1787759202.029461:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:3305:x1874601334292736:12345-0@lo:400: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.029471:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787759202.029478:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334292736:0@lo:400: 00000100:00100000:0.0:1787759202.029486:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601334293120:12345-0@lo:400: Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.029502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759202.029518:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981634f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334292992:12345-0@lo:400: Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.029528:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787759202.029553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787759202.029561:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759202.029573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334292864 00000100:00100000:3.0:1787759202.029578:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334292864 00010000:00080000:2.0:1787759202.029604:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbd2c0 x1874601334292992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787759202.029607:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbe1c0 x1874601334293120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759202.029626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759202.029650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334292864:12345-0@lo:400: 00000100:00100000:1.0:1787759202.029656:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601334293120:0@lo:400: 00000100:00100000:2.0:1787759202.029657:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334292992:0@lo:400: 00000100:00100000:3.0:1787759202.030209:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334292864:12345-0@lo:400: Request processed in 560us (654us total) trans 0 rc 0/0 00010000:00080000:0.0:1787759202.030214:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbda40 x1874601334292864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759202.030221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787759202.030231:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334292864:0@lo:400: 00010000:00010000:2.0:1787759202.476974:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787759202.541151:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787759202.541159:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa82f2f000 from 30 10000000:01000000:0.0:1787759202.541164:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787759202.541656:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.541687:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.541708:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.541745:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293248:0@lo:101: 00000100:00100000:0.0:1787759202.541867:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.541936:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.541966:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293248 00000100:00100000:1.0:1787759202.541975:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293248 00000100:00100000:1.0:1787759202.542040:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787759202.542052:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334293248:12345-0@lo:101: 00010000:00010000:1.0:1787759202.542068:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759202.542085:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df58 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.542163:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df58 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.542175:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df58 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.542184:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168e600, rc 0) 00000100:00100000:1.0:1787759202.542230:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293248:12345-0@lo:101: Request processed in 181us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.542237:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787759202.542555:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293248:0@lo:101: 00010000:00010000:0.0:1787759202.542571:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.542581:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.542638:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293376:0@lo:501: 00000100:00100000:0.0:1787759202.542665:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.542683:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.542711:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293376 00000100:00100000:1.0:1787759202.542717:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293376 00000100:00100000:1.0:1787759202.542816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787759202.542829:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293376:12345-0@lo:501: 00000100:00100000:0.0:1787759202.543366:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293376:0@lo:501: 00000100:00100000:1.0:1787759202.543388:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293376:12345-0@lo:501: Request processed in 562us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.543398:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293504:0@lo:503: 00000100:00100000:0.0:1787759202.543437:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.543467:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.543510:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293504 00000100:00100000:2.0:1787759202.543521:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293504 00000100:00100000:1.0:1787759202.543537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787759202.543586:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787759202.543695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293504:12345-0@lo:503: 00000100:00100000:2.0:1787759202.544170:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293504:12345-0@lo:503: Request processed in 574us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.544179:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787759202.544252:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293504:0@lo:503: 00000100:00100000:2.0:1787759202.544909:0:8196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8196:1874601334293632:0@lo:502: 00000100:00100000:2.0:1787759202.544963:0:8196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759202.545002:0:8196:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fabcbe9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.545117:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293632 00000100:00100000:3.0:1787759202.545123:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293632 00000100:00100000:3.0:1787759202.545169:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787759202.545178:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+14:8196:x1874601334293632:12345-0@lo:502: 00000100:00100000:3.0:1787759202.545397:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+14:8196:x1874601334293632:12345-0@lo:502: Request processed in 221us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.545402:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787759202.545511:0:8196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8196:1874601334293632:0@lo:502: 00000100:00100000:2.0:1787759202.545547:0:8196:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8196:1874601334293760:0@lo:502: 00000100:00100000:2.0:1787759202.545572:0:8196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759202.545595:0:8196:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fabcbe9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.545618:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293760 00000100:00100000:1.0:1787759202.545623:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293760 00000100:00100000:1.0:1787759202.545671:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787759202.545680:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:8196:x1874601334293760:12345-0@lo:502: 00000100:00100000:1.0:1787759202.546086:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:8196:x1874601334293760:12345-0@lo:502: Request processed in 400us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.546099:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787759202.546138:0:8196:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8196:1874601334293760:0@lo:502: 00000040:00080000:2.0:1787759202.546164:0:8196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787759202.546414:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787759202.546448:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759202.546458:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.546469:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759202.546479:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787759202.546482:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787759202.546485:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787759202.546519:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.546526:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.546534:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.546552:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293888:0@lo:101: 00000100:00100000:0.0:1787759202.546587:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.546625:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.546645:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334293888 00000100:00100000:3.0:1787759202.546652:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334293888 00000100:00100000:3.0:1787759202.546705:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787759202.546713:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334293888:12345-0@lo:101: 00010000:00010000:3.0:1787759202.546723:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759202.546742:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df66 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759202.546982:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df66 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759202.546996:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df66 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759202.547005:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6600, rc 0) 00000100:00100000:3.0:1787759202.547091:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334293888:12345-0@lo:101: Request processed in 378us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.547098:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787759202.547159:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334293888:0@lo:101: 00010000:00010000:0.0:1787759202.547175:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.547185:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.547234:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294016:0@lo:501: 00000100:00100000:0.0:1787759202.547321:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.547348:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.547387:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294016 00000100:00100000:1.0:1787759202.547390:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294016 00000100:00100000:1.0:1787759202.547451:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787759202.547458:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334294016:12345-0@lo:501: 00000100:00100000:1.0:1787759202.547677:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334294016:12345-0@lo:501: Request processed in 220us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.547682:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787759202.547732:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294016:0@lo:501: 00000100:00100000:0.0:1787759202.547797:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294144:0@lo:503: 00000100:00100000:0.0:1787759202.547854:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.547993:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.548006:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294144 00000100:00100000:1.0:1787759202.548017:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294144 00000100:00100000:1.0:1787759202.548080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787759202.548092:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334294144:12345-0@lo:503: 00000100:00100000:1.0:1787759202.548711:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334294144:12345-0@lo:503: Request processed in 621us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.548720:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787759202.548777:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294144:0@lo:503: 00000100:00100000:1.0:1787759202.549126:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8197:1874601334294272:0@lo:502: 00000100:00100000:1.0:1787759202.549174:0:8197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.549204:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f57c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.549219:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294272 00000100:00100000:2.0:1787759202.549225:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294272 00000100:00100000:2.0:1787759202.549262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787759202.549270:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:8197:x1874601334294272:12345-0@lo:502: 00000100:00100000:2.0:1787759202.549447:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:8197:x1874601334294272:12345-0@lo:502: Request processed in 177us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.549454:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787759202.549606:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8197:1874601334294272:0@lo:502: 00000020:01000000:1.0:1787759202.549632:0:8197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759202.549641:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759202.549648:0:8197:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787759202.549653:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787759202.549655:0:8197:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787759202.549676:0:8197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8197:1874601334294400:0@lo:502: 00000100:00100000:1.0:1787759202.549710:0:8197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759202.549953:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294400 00000100:00100000:2.0:1787759202.549959:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294400 00000100:00100000:1.0:1787759202.549972:0:8197:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f57c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.549992:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787759202.550000:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:8197:x1874601334294400:12345-0@lo:502: 00000100:00100000:2.0:1787759202.550127:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:8197:x1874601334294400:12345-0@lo:502: Request processed in 127us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.550200:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787759202.550220:0:8197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8197:1874601334294400:0@lo:502: 00000020:01000000:1.0:1787759202.550241:0:8197:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759202.550246:0:8197:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759202.550248:0:8197:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787759202.550252:0:8197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787759202.550424:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787759202.550442:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787759202.550451:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.550462:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759202.550472:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787759202.550475:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa851c2800 from 30 10000000:01000000:0.0:1787759202.550478:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787759202.550511:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.550519:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.550528:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.550543:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294528:0@lo:101: 00000100:00100000:0.0:1787759202.550581:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.550608:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.550665:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294528 00000100:00100000:2.0:1787759202.550670:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294528 00000100:00100000:2.0:1787759202.550743:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787759202.550805:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334294528:12345-0@lo:101: 00010000:00010000:2.0:1787759202.550815:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759202.550827:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df74 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.550847:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df74 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.550870:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df74 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.550879:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151aa00, rc 0) 00000100:00100000:2.0:1787759202.550931:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334294528:12345-0@lo:101: Request processed in 181us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.550937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787759202.551001:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294528:0@lo:101: 00010000:00010000:0.0:1787759202.551025:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.551034:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.551075:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294656:0@lo:501: 00000100:00100000:0.0:1787759202.551112:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.552308:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.553324:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294656 00000100:00100000:1.0:1787759202.553332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294656 00000100:00100000:1.0:1787759202.553381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787759202.553391:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334294656:12345-0@lo:501: 00000100:00100000:1.0:1787759202.553668:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334294656:12345-0@lo:501: Request processed in 278us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.553677:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787759202.553804:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294656:0@lo:501: 00000100:00100000:0.0:1787759202.553850:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294784:0@lo:503: 00000100:00100000:0.0:1787759202.553997:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.554039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294784 00000100:00100000:1.0:1787759202.554043:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294784 00000100:00100000:1.0:1787759202.554064:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787759202.554072:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334294784:12345-0@lo:503: 00000100:00100000:0.0:1787759202.554139:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759202.554293:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334294784:12345-0@lo:503: Request processed in 222us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.554301:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787759202.554388:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334294784:0@lo:503: 00000100:00100000:1.0:1787759202.555157:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8198:1874601334294912:0@lo:502: 00000100:00100000:1.0:1787759202.555195:0:8198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.555255:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.555291:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334294912 00000100:00100000:2.0:1787759202.555296:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334294912 00000100:00100000:2.0:1787759202.555333:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787759202.555342:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:8198:x1874601334294912:12345-0@lo:502: 00000100:00100000:2.0:1787759202.555518:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:8198:x1874601334294912:12345-0@lo:502: Request processed in 177us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.555526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787759202.555542:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8198:1874601334294912:0@lo:502: 00000100:00100000:1.0:1787759202.555606:0:8198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8198:1874601334295040:0@lo:502: 00000100:00100000:1.0:1787759202.555640:0:8198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.555659:0:8198:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.555845:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295040 00000100:00100000:3.0:1787759202.555850:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295040 00000100:00100000:3.0:1787759202.555881:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787759202.555889:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:8198:x1874601334295040:12345-0@lo:502: 00000100:00100000:3.0:1787759202.556065:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:8198:x1874601334295040:12345-0@lo:502: Request processed in 176us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.556072:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787759202.556095:0:8198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8198:1874601334295040:0@lo:502: 00000040:00080000:1.0:1787759202.556119:0:8198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787759202.556198:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787759202.556216:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759202.556226:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.556237:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759202.556246:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787759202.556248:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98fa851c2800 from 5 10000000:01000000:0.0:1787759202.556258:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787759202.556288:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.556296:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.556304:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.556316:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295168:0@lo:101: 00000100:00100000:0.0:1787759202.556342:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.556365:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.556383:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295168 00000100:00100000:2.0:1787759202.556388:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295168 00000100:00100000:2.0:1787759202.556418:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787759202.556425:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334295168:12345-0@lo:101: 00010000:00010000:2.0:1787759202.556434:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759202.556446:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151be00/0xec1488f14640df89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df82 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.556466:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151be00/0xec1488f14640df89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df82 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.556476:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151be00/0xec1488f14640df89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df82 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.556494:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151be00, rc 0) 00000100:00100000:0.0:1787759202.556576:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295168:0@lo:101: 00010000:00010000:0.0:1787759202.556589:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759202.556599:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334295168:12345-0@lo:101: Request processed in 173us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759202.556602:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759202.556608:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787759202.556656:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295296:0@lo:256: 00000100:00100000:0.0:1787759202.556679:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.556702:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.556786:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295296 00000100:00100000:3.0:1787759202.556791:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295296 00000100:00100000:3.0:1787759202.556817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787759202.556824:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334295296:12345-0@lo:256: 20000000:01000000:3.0:1787759202.556838:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787759202.556854:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787759202.556856:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787759202.556918:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334295296:12345-0@lo:256: Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.556925:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787759202.557002:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295296:0@lo:256: 10000000:01000000:0.0:1787759202.557045:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787759202.557051:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.557059:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806f000/0xec1488f14640df82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df89 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759202.557071:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787759202.557073:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787759202.557075:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787759202.557088:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.557092:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.557097:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.557106:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295424:0@lo:101: 00000100:00100000:0.0:1787759202.557130:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.557160:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.557187:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295424 00000100:00100000:2.0:1787759202.557197:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295424 00000100:00100000:2.0:1787759202.557226:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787759202.557233:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334295424:12345-0@lo:101: 00010000:00010000:2.0:1787759202.557239:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759202.557262:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640df90 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.557277:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640df90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.557287:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759202.557293:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151a200, rc 0) 00000100:00100000:2.0:1787759202.557329:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334295424:12345-0@lo:101: Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.557335:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787759202.557382:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295424:0@lo:101: 00010000:00010000:0.0:1787759202.557392:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.557400:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.557437:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295552:0@lo:501: 00000100:00100000:0.0:1787759202.557460:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.557479:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.557505:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295552 00000100:00100000:3.0:1787759202.557510:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295552 00000100:00100000:3.0:1787759202.557548:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787759202.557557:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334295552:12345-0@lo:501: 00000100:00100000:3.0:1787759202.557811:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334295552:12345-0@lo:501: Request processed in 255us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.557818:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787759202.557843:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295552:0@lo:501: 00000100:00100000:0.0:1787759202.557885:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295680:0@lo:503: 00000100:00100000:0.0:1787759202.557923:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.557951:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759202.558071:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295680 00000100:00100000:2.0:1787759202.558076:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295680 00000100:00100000:2.0:1787759202.558100:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787759202.558108:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334295680:12345-0@lo:503: 00000100:00100000:2.0:1787759202.558356:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334295680:12345-0@lo:503: Request processed in 248us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.558370:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787759202.558386:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334295680:0@lo:503: 00000100:00100000:2.0:1787759202.558650:0:8199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8199:1874601334295808:0@lo:502: 00000100:00100000:2.0:1787759202.558682:0:8199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759202.558705:0:8199:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faadb553c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.558795:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295808 00000100:00100000:3.0:1787759202.558799:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295808 00000100:00100000:3.0:1787759202.558830:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787759202.558837:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:8199:x1874601334295808:12345-0@lo:502: 00000100:00100000:3.0:1787759202.559045:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:8199:x1874601334295808:12345-0@lo:502: Request processed in 208us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.559053:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787759202.559073:0:8199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8199:1874601334295808:0@lo:502: 00000020:01000000:2.0:1787759202.559097:0:8199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787759202.559103:0:8199:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787759202.559110:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759202.559113:0:8199:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787759202.559119:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787759202.559122:0:8199:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.109@tcp to nid 0x20000c0a8cc6d (192.168.204.109@tcp) 00000020:01000000:2.0:1787759202.559155:0:8199:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787759202.559158:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787759202.559180:0:8199:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98fab461b490) 00000020:00000080:2.0:1787759202.559199:0:8199:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787759202.559205:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787759202.559272:0:8199:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787759202.559278:0:8199:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787759202.559285:0:8199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xec1488f14640dfa5 00010000:00080000:2.0:1787759202.559311:0:8199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98f981da5000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.109@tcp at head 00010000:00010000:2.0:1787759202.559522:0:8199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787759202.559968:0:8199:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787759202.559980:0:8199:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787759202.560437:0:8199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759202.560631:0:8199:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759202.560677:0:8199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787759202.560734:0:8199:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787759202.561333:0:8200:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787759202.561349:0:8200:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787759202.561695:0:8199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759202.561705:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787759202.561733:0:8199:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787759202.561792:0:8199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xec1488f14640dfac 00000100:00080000:2.0:1787759202.561801:0:8199:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787759202.561807:0:8199:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98f981da5000 using connection 192.168.204.109@tcp/0@lo 00000100:00100000:2.0:1787759202.561839:0:8199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98f9816343c0 x1874601334295936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787759202.561859:0:8199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787759202.561927:0:8199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759202.561932:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759202.561935:0:8199:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787759202.561938:0:8199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759202.561943:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759202.561945:0:8199:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787759202.561950:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787759202.561952:0:8199:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787759202.561990:0:8199:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981636940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8199:1874601334296448:0@lo:502: 00000100:00100000:3.0:1787759202.562000:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334296064:0@lo:400: 00000100:00100000:0.0:1787759202.562086:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601334295936:0@lo:8: 00000100:00100000:3.0:1787759202.562173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.562215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759202.562223:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334296192:0@lo:400: 00000100:00100000:0.0:1787759202.562230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.562267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.562282:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296064 00000100:00100000:1.0:1787759202.562290:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296064 00000100:00100000:3.0:1787759202.562311:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334296320:0@lo:400: 00000100:00100000:1.0:1787759202.562340:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296192 00000100:00100000:3.0:1787759202.562341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.562347:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296192 00000100:00100000:3.0:1787759202.562368:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759202.562384:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759202.562387:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601334296576:0@lo:400: 00000100:00100000:0.0:1787759202.562394:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787759202.562400:0:8199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.562401:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334296064:12345-0@lo:400: 00000100:00100000:0.0:1787759202.562410:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334296192:12345-0@lo:400: 00000100:00100000:3.0:1787759202.562426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759202.562433:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296448 00000100:00100000:2.0:1787759202.562438:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296448 00000100:00100000:3.0:1787759202.562466:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334295936 00000100:00100000:3.0:1787759202.562472:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334295936 00000100:00100000:0.0:1787759202.562483:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4627840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334296192:12345-0@lo:400: Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.562483:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787759202.562485:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4625e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334296064:12345-0@lo:400: Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.562499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787759202.562500:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:8199:x1874601334296448:12345-0@lo:502: 00000100:00100000:3.0:1787759202.562500:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296320 00000100:00100000:3.0:1787759202.562506:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296320 00000100:00100000:1.0:1787759202.562507:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787759202.562517:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296576 00000100:00100000:0.0:1787759202.562522:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296576 00000100:00100000:3.0:1787759202.562551:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759202.562561:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334296320:12345-0@lo:400: 00000100:00100000:1.0:1787759202.562574:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787759202.562582:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1874601334295936:12345-0@lo:8: 00000100:00100000:3.0:1787759202.562610:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4627480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334296320:12345-0@lo:400: Request processed in 49us (268us total) trans 0 rc 0/0 00010000:00080000:1.0:1787759202.562614:0:6677:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 109 last 0 00000100:00100000:0.0:1787759202.562617:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759202.562626:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759202.562632:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601334296576:12345-0@lo:400: 00000020:00000080:1.0:1787759202.562652:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xec1488f14640dfb3 00002000:00100000:1.0:1787759202.562667:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98f98321c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787759202.562677:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787759202.562682:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:3.0:1787759202.562684:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbe1c0 x1874601334296320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.562687:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4627c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601334296576:12345-0@lo:400: Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.562696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759202.562711:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787759202.562727:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334296320:0@lo:400: 00010000:00080000:0.0:1787759202.562783:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbd2c0 x1874601334296192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.562798:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334296192:0@lo:400: 00010000:00080000:3.0:1787759202.562799:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbd680 x1874601334296576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759202.562810:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:8199:x1874601334296448:12345-0@lo:502: Request processed in 313us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.562818:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601334296576:0@lo:400: 00000100:00100000:2.0:1787759202.562823:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1787759202.562824:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa99cbda40 x1874601334296064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.562836:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334296064:0@lo:400: 00000100:00100000:3.0:1787759202.562867:0:8199:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.562882:0:8199:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981636940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8199:1874601334296448:0@lo:502: 00002000:00100000:1.0:1787759202.562903:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:3.0:1787759202.562908:0:8199:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759202.562914:0:8199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759202.562916:0:8199:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759202.562920:0:8199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787759202.563013:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787759202.563033:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787759202.563047:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.563054:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759202.563062:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787759202.563064:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98fa9a7c0000 from 1 10000000:01000000:0.0:1787759202.563066:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759202.563088:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.563093:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759202.563099:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759202.563109:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a384b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334296704:0@lo:101: 00000100:00100000:0.0:1787759202.563136:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1787759202.563137:0:6677:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1787759202.563154:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4aa80 going to sleep for 11 seconds 00000100:00080000:1.0:1787759202.563157:0:6677:0:(import.c:65:import_set_state_nolock()) ffff98f98321b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759202.563174:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296704 00000100:00100000:3.0:1787759202.563180:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296704 00000100:00100000:3.0:1787759202.563217:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787759202.563230:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334296704:12345-0@lo:101: 00010000:00010000:3.0:1787759202.563239:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759202.563250:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640dfba expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759202.563264:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874601334295936:12345-0@lo:8: Request processed in 680us (1036us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759202.563271:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640dfba expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759202.563281:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787759202.563291:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dfba expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759202.563301:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c7800, rc 0) 00000100:00100000:3.0:1787759202.563336:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334296704:12345-0@lo:101: Request processed in 107us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.563344:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787759202.563346:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a384b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334296704:0@lo:101: 00010000:00010000:1.0:1787759202.563359:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.563366:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787759202.563398:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f9816343c0 x1874601334295936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787759212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759202.563399:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334296832:0@lo:501: 00000100:00100000:0.0:1787759202.563412:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787759202.563418:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787759202.563426:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:1.0:1787759202.563427:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787759202.563433:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787759202.563436:0:3302:0:(import.c:65:import_set_state_nolock()) ffff98f981da5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787759202.563446:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f57780 going to sleep for 11 seconds 00000004:00080000:0.0:1787759202.563462:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787759202.563469:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296832 00000100:00100000:2.0:1787759202.563474:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296832 00000100:00100000:0.0:1787759202.563477:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f9816343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601334295936:0@lo:8: 00000100:00100000:2.0:1787759202.563505:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787759202.563524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334296832:12345-0@lo:501: 00000100:00100000:1.0:1787759202.563793:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334296832:0@lo:501: 00000100:00100000:2.0:1787759202.563795:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334296832:12345-0@lo:501: Request processed in 274us (364us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759202.563807:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000004:00080000:2.0:1787759202.563834:0:8200:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 10000000:01000000:1.0:1787759202.563844:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787759202.563852:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.563859:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787759202.563907:0:8200:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 109046155478ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787759202.580697:0:8201:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787759202.580716:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334296960:0@lo:13: 00000100:00100000:3.0:1787759202.580729:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4625680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297088:0@lo:7: 00000001:00100000:0.0:1787759202.580829:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6adecffe-4523-438b-8da7-1d705d9fa828 00000004:00080000:0.0:1787759202.580844:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787759202.580856:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.580856:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.580922:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa86357c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.580948:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297088 00000100:00100000:3.0:1787759202.580956:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297088 00000100:00100000:1.0:1787759202.580961:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334296960 00000100:00100000:1.0:1787759202.580967:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334296960 00000100:00100000:1.0:1787759202.581016:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787759202.581026:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874601334296960:12345-0@lo:13: 00002000:00000024:1.0:1787759202.581056:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787759202.581078:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759202.581089:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8201:x1874601334297088:12345-0@lo:7: 00000100:00100000:1.0:1787759202.581113:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874601334296960:12345-0@lo:13: Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.581121:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787759202.581159:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab4624000 x1874601334296960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759202.581179:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334296960:0@lo:13: 00000100:00080000:2.0:1787759202.581858:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1787759202.586049:0:7621:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1787759202.586057:0:7621:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787759202.586160:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8201:x1874601334297088:12345-0@lo:7: Request processed in 5070us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.586172:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787759202.586321:0:8201:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab4625680 x1874601334297088/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787759218 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759202.586334:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4625680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297088:0@lo:7: 00000004:00080000:1.0:1787759202.586348:0:8201:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787759202.586387:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297216:0@lo:5: 00000100:00100000:1.0:1787759202.586423:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759202.586519:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab3f57d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.586609:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297216 00000100:00100000:3.0:1787759202.586614:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297216 00000100:00100000:3.0:1787759202.586647:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759202.586652:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8201:x1874601334297216:12345-0@lo:5: 00002000:00080000:3.0:1787759202.586671:0:6678:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787759202.586673:0:6678:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787759202.586956:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8201:x1874601334297216:12345-0@lo:5: Request processed in 302us (532us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787759202.586962:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787759202.587117:0:8201:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa8a31c000 x1874601334297216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759218 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.587129:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297216:0@lo:5: 00000004:00080000:0.0:1787759202.587139:0:8201:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787759202.587162:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a3870c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297344:0@lo:700: 00000100:00100000:0.0:1787759202.587187:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.587212:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.587258:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297344 00000100:00100000:3.0:1787759202.587262:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297344 00000100:00100000:3.0:1787759202.587292:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759202.587299:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8201:x1874601334297344:12345-0@lo:700: 00000100:00100000:3.0:1787759202.587324:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874601334297472:0@lo:700: 00000100:00100000:3.0:1787759202.587351:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759202.587415:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa86357900 going to sleep for 11 seconds 00000100:00100000:0.0:1787759202.587492:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297472 00000100:00100000:0.0:1787759202.587496:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297472 00000100:00100000:0.0:1787759202.587533:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787759202.587540:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874601334297472:12345-0@lo:700: 40000000:02000000:1.0:1787759202.602434:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787759202.607927:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4626940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874601334297472:12345-0@lo:700: Request processed in 20379us (20566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.607941:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787759202.608170:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab46243c0 x1874601334297472/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787759218 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759202.608186:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874601334297472:0@lo:700: 40000000:02000000:2.0:1787759202.608210:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787759202.657035:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787759202.657123:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787759202.657134:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8201:x1874601334297344:12345-0@lo:700: Request processed in 69830us (69940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.657153:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787759202.657226:0:8201:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa8a3870c0 x1874601334297344/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787759218 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759202.657243:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a3870c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297344:0@lo:700: 00000004:02000040:0.0:1787759202.668396:0:8201:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787759202.671476:0:8201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a385680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297600:0@lo:5: 00000100:00100000:0.0:1787759202.671544:0:8201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759202.671622:0:8201:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa82d4acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759202.671643:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297600 00000100:00100000:3.0:1787759202.671652:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297600 00000100:00100000:3.0:1787759202.671724:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759202.671736:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8201:x1874601334297600:12345-0@lo:5: 00002000:00080000:3.0:1787759202.676147:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787759202.676168:0:6676:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787759202.678732:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a3870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8201:x1874601334297600:12345-0@lo:5: Request processed in 6993us (7181us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787759202.678746:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787759202.678817:0:8201:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa8a385680 x1874601334297600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759218 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.678827:0:8201:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787759202.678840:0:8201:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98fa8a385680 x1874601334297600/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759218 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759202.678853:0:8201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a385680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8201:1874601334297600:0@lo:5: 00000004:00080000:0.0:1787759202.678865:0:8201:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787759202.922269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759202.922297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759202.922342:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841088 00000100:00100000:3.0:1787759202.922353:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841088 00000100:00100000:0.0:1787759202.922371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841216 00000100:00100000:0.0:1787759202.922377:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841216 00000100:00080000:1.0:1787759202.922421:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759202.922434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 5 00000100:00100000:3.0:1787759202.922449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 6 00000100:00100000:0.0:1787759202.922451:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adecffe-4523-438b-8da7-1d705d9fa828+6:5567:x1874601324841216:12345-192.168.204.9@tcp:41: 00000100:00100000:1.0:1787759202.922457:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787759202.922465:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adecffe-4523-438b-8da7-1d705d9fa828+6:0:x1874601324841088:12345-192.168.204.9@tcp:41: 00000100:00100000:1.0:1787759202.922468:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000004:00000024:0.0:1787759202.922495:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:3.0:1787759202.922498:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787759202.922574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adecffe-4523-438b-8da7-1d705d9fa828+6:0:x1874601324841088:12345-192.168.204.9@tcp:41: Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.922575:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adecffe-4523-438b-8da7-1d705d9fa828+6:5567:x1874601324841216:12345-192.168.204.9@tcp:41: Request processed in 127us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.922590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 6 00000100:00100000:0.0:1787759202.922597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 5 00000100:00100000:0.0:1787759202.923996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759202.924083:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841344 00000100:00100000:1.0:1787759202.924090:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841344 00000100:00100000:1.0:1787759202.924133:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 7 00000100:00100000:1.0:1787759202.924150:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:5567:x1874601324841344:12345-192.168.204.9@tcp:40: 00000100:00100000:1.0:1787759202.924211:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:5567:x1874601324841344:12345-192.168.204.9@tcp:40: Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.924218:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 7 00000100:00100000:2.0:1787759202.925673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759202.925712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759202.925810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759202.925849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759202.925864:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841728 00000100:00100000:1.0:1787759202.925872:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841472 00000100:00100000:0.0:1787759202.925875:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841728 00000100:00100000:2.0:1787759202.925883:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841856 00000100:00100000:1.0:1787759202.925886:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841472 00000100:00100000:2.0:1787759202.925891:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841856 00000100:00100000:3.0:1787759202.925892:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841600 00000100:00100000:3.0:1787759202.925900:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841600 00000100:00100000:2.0:1787759202.925955:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 123 00000100:00100000:1.0:1787759202.925965:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 8 00000100:00100000:2.0:1787759202.925972:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2349:x1874601324841856:12345-192.168.204.9@tcp:400: 00000100:00100000:1.0:1787759202.925985:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981635a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1874601324841472:12345-192.168.204.9@tcp:8: 00000100:00100000:0.0:1787759202.926022:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 0 00000100:00100000:3.0:1787759202.926022:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 9 00010000:00080000:1.0:1787759202.926027:0:6677:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 6adecffe-4523-438b-8da7-1d705d9fa828@192.168.204.9@tcp t0 exp 0000000000000000 cur 109 last 0 00000100:00100000:3.0:1787759202.926041:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1874601324841600:12345-192.168.204.9@tcp:8: 00000100:00100000:2.0:1787759202.926056:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2349:x1874601324841856:12345-192.168.204.9@tcp:400: Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759202.926057:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:5567:x1874601324841728:12345-192.168.204.9@tcp:33: 00010000:00080000:3.0:1787759202.926073:0:6678:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 6adecffe-4523-438b-8da7-1d705d9fa828@192.168.204.9@tcp t0 exp 0000000000000000 cur 109 last 0 00000100:00100000:2.0:1787759202.926074:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 123 00000020:00000080:1.0:1787759202.926082:0:6677:0:(genops.c:1385:class_connect()) connect: client 6adecffe-4523-438b-8da7-1d705d9fa828, cookie 0xec1488f14640dfc8 00002000:00100000:1.0:1787759202.926104:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6adecffe-4523-438b-8da7-1d705d9fa828/ffff98fabcbc4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1787759202.926135:0:6678:0:(genops.c:1385:class_connect()) connect: client 6adecffe-4523-438b-8da7-1d705d9fa828, cookie 0xec1488f14640dfcf 00002000:00100000:1.0:1787759202.926142:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1787759202.926151:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6adecffe-4523-438b-8da7-1d705d9fa828/ffff98f981d14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787759202.926169:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787759202.926578:0:6678:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787759202.926614:0:6678:0:(import.c:65:import_set_state_nolock()) ffff98f981d17000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1787759202.926727:0:6677:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787759202.926739:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+6:2345:x1874601324841600:12345-192.168.204.9@tcp:8: Request processed in 701us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759202.926782:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 9 00000100:00080000:1.0:1787759202.926812:0:6677:0:(import.c:65:import_set_state_nolock()) ffff98fabcbc7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787759202.926896:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981635a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adecffe-4523-438b-8da7-1d705d9fa828+6:2345:x1874601324841472:12345-192.168.204.9@tcp:8: Request processed in 914us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.926908:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 8 00000004:00080000:2.0:1787759202.935125:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8998us 00000004:00200000:2.0:1787759202.941918:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787759202.942094:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981636940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:5567:x1874601324841728:12345-192.168.204.9@tcp:33: Request processed in 16043us (16279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759202.942118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 0 00000100:00100000:2.0:1787759203.021972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759203.022063:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324841984 00000100:00100000:0.0:1787759203.022073:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324841984 00000100:00100000:0.0:1787759203.022131:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 8 00000100:00100000:0.0:1787759203.022141:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adecffe-4523-438b-8da7-1d705d9fa828+5:5606:x1874601324841984:12345-192.168.204.9@tcp:101: 00010000:00010000:0.0:1787759203.022166:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759203.022314:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806ec00/0xec1488f14640dfd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef61cc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022447:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806f600/0xec1488f14640dfdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022479:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806f600/0xec1488f14640dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022503:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806f600/0xec1488f14640dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787759203.022690:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787759203.022694:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787759203.022824:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806f600/0xec1488f14640dfdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022852:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806ec00/0xec1488f14640dfd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61cc expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022869:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98fa8806f600/0xec1488f14640dfdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61cc expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.022878:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98fa83b13b00) 00010000:00010000:0.0:1787759203.022881:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787759203.022884:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8806f600, rc 0) 00000100:00100000:0.0:1787759203.023486:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981635680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6adecffe-4523-438b-8da7-1d705d9fa828+6:5606:x1874601324841984:12345-192.168.204.9@tcp:101: Request processed in 1344us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759203.023495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 8 00010000:00010000:3.0:1787759203.501089:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759204.506841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759204.506922:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842112 00000100:00100000:1.0:1787759204.506933:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842112 00000100:00100000:1.0:1787759204.507033:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 3 00000100:00100000:1.0:1787759204.507047:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adecffe-4523-438b-8da7-1d705d9fa828+6:5658:x1874601324842112:12345-192.168.204.9@tcp:13: 00002000:00000024:1.0:1787759204.507074:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787759204.507151:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4625a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adecffe-4523-438b-8da7-1d705d9fa828+6:5658:x1874601324842112:12345-192.168.204.9@tcp:13: Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.507160:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 3 00000100:00080000:2.0:1787759204.507441:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759204.509279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759204.509350:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842240 00000100:00100000:0.0:1787759204.509358:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842240 00000100:00080000:2.0:1787759204.509405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787759204.509420:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 4 00000100:00100000:0.0:1787759204.509433:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adecffe-4523-438b-8da7-1d705d9fa828+6:5658:x1874601324842240:12345-192.168.204.9@tcp:13: 00002000:00000024:0.0:1787759204.509451:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759204.509509:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6adecffe-4523-438b-8da7-1d705d9fa828+6:5658:x1874601324842240:12345-192.168.204.9@tcp:13: Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759204.509516:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 4 00010000:00010000:2.0:1787759204.525975:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759205.548857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759205.566441:0:8288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787759206.572913:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759206.636963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334297728:0@lo:13: 00000100:00100000:3.0:1787759206.637038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759206.637075:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297728 00000100:00100000:2.0:1787759206.637083:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297728 00000100:00080000:1.0:1787759206.637120:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787759206.637295:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787759206.637310:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334297728:12345-0@lo:13: 00002000:00000024:0.0:1787759206.637401:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759206.637472:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334297728:12345-0@lo:13: Request processed in 166us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759206.637482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787759206.637602:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab4624b40 x1874601334297728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759206.637622:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334297728:0@lo:13: 00000001:00100000:3.0:1787759206.649806:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6adecffe-4523-438b-8da7-1d705d9fa828 00000020:00000080:1.0:1787759206.970594:0:8438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc77465c80 20000000:00000080:1.0:1787759206.970610:0:8438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f9823be400 uarg=0000000000000000 20000000:01000000:1.0:1787759206.970644:0:8438:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787759206.970646:0:8438:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787759206.970649:0:8438:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787759206.970653:0:8438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787759206.970659:0:8438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787759206.970672:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787759206.970675:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787759206.971160:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787759206.971163:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759206.971815:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787759206.972146:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787759206.972188:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787759206.972223:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787759206.972233:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787759206.972234:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759206.972723:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787759206.972971:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787759206.973005:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787759206.973069:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787759206.973077:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787759206.973078:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759206.973612:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787759206.973962:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787759206.974014:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787759206.974052:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787759206.974063:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787759206.974065:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759206.974495:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787759206.974842:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787759206.974897:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787759206.974934:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1787759206.974958:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787759206.974977:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.974996:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640deda expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975004:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df04 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975013:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975021:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975029:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df58 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975036:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975044:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df74 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975052:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640df90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975059:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640dfba expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975066:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975104:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975118:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 18 pid: 5828 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.975131:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334297856:0@lo:104: 00000100:00100000:1.0:1787759206.975191:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759206.975257:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.975262:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297856 00010000:00010000:1.0:1787759206.975270:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 18 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.975270:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297856 00000100:00100000:1.0:1787759206.975282:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334297984:0@lo:104: 00000100:00100000:1.0:1787759206.975309:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759206.975370:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787759206.975371:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334297984 00000100:00100000:0.0:1787759206.975378:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334297984 00010000:00010000:1.0:1787759206.975383:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975394:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 18 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.975404:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298112:0@lo:104: 00000100:00100000:0.0:1787759206.975408:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787759206.975418:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787759206.975423:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334297856:12345-0@lo:104: 00000100:00100000:2.0:1787759206.975433:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981627850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334297984:12345-0@lo:104: 00000100:00100000:1.0:1787759206.975434:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759206.975438:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.975457:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975465:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975476:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.975495:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298240:0@lo:104: 00010000:00010000:0.0:1787759206.975501:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787759206.975509:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334297856:12345-0@lo:104: Request processed in 92us (317us total) trans 0 rc 0/0 00010000:00010000:2.0:1787759206.975511:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759206.975522:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787759206.975522:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981627850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334297984:12345-0@lo:104: Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759206.975528:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759206.975537:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787759206.975546:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334298112 00000100:00100000:0.0:1787759206.975551:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334298112 00010000:00010000:1.0:1787759206.975554:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975564:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 18 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.975574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334298240 00000100:00100000:1.0:1787759206.975575:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa98db52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298368:0@lo:104: 00000100:00100000:0.0:1787759206.975580:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334298240 00000100:00100000:2.0:1787759206.975586:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787759206.975596:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298112:12345-0@lo:104: 00010000:00010000:2.0:1787759206.975603:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.975607:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759206.975613:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759206.975621:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa98db6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298240:12345-0@lo:104: 00010000:00010000:0.0:1787759206.975635:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975640:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.975658:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 9 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.975668:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787759206.975670:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298496:192.168.204.9@tcp:104: 00000100:00100000:2.0:1787759206.975694:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298112:12345-0@lo:104: Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759206.975702:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787759206.975715:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334298368 00000100:00100000:2.0:1787759206.975719:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334298368 00010000:00010000:3.0:1787759206.975726:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787759206.975734:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.975742:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787759206.975746:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8806fe00 already unused, calling callback (ffffffffc1a5dc20) 00000100:00100000:2.0:1787759206.975773:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298368:12345-0@lo:104: 10000000:00010000:3.0:1787759206.975780:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.975783:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975794:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759206.975810:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759206.975816:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759206.975848:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975856:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759206.975872:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975878:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8806fe00/0xec1488f14640dfba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dfc1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975889:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787759206.975898:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975903:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8806e200 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759206.975906:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.975914:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759206.975920:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759206.975925:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787759206.976024:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.976034:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 9 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976042:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298752:192.168.204.9@tcp:104: 00010000:00010000:3.0:1787759206.976094:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976100:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759206.976106:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976112:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640df90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df97 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976121:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759206.976124:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976129:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8806ea00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:3.0:1787759206.976132:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976148:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759206.976155:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759206.976160:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759206.976178:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976183:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759206.976193:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976198:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8806ea00/0xec1488f14640df74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df7b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.976204:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759206.976205:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759206.976206:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759206.976210:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759206.976224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334298624:0@lo:103: 00010000:00010000:0.0:1787759206.976263:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787759206.976270:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa98db6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298240:12345-0@lo:104: Request processed in 653us (745us total) trans 0 rc 0/0 00010000:00010000:1.0:1787759206.976280:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.976287:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787759206.976287:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787759206.976294:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 18 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.976298:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334298368:12345-0@lo:104: Request processed in 547us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759206.976313:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787759206.976319:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334299136:0@lo:104: 00010000:00010000:2.0:1787759206.976337:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787759206.976343:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976353:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759206.976355:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80031c00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:2.0:1787759206.976360:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.976368:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759206.976374:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759206.976392:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787759206.976395:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640deda expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.976405:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640deda expref: 18 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976416:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334299264:0@lo:104: 00010000:00010000:2.0:1787759206.976416:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.976417:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759206.976425:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.976430:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759206.976438:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa80031000 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:0.0:1787759206.976442:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976446:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759206.976455:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759206.976462:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976464:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae52ed80 going to sleep for 11 seconds 10000000:01000000:0.0:1787759206.976471:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787759206.976484:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334297856:0@lo:104: 00010000:00010000:0.0:1787759206.976489:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.976492:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976495:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334297984:0@lo:104: 00010000:00010000:0.0:1787759206.976501:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759206.976508:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa80031c00/0xec1488f14640df66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df6d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976509:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298112:0@lo:104: 00010000:00010000:0.0:1787759206.976511:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976524:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298240:0@lo:104: 00010000:00010000:2.0:1787759206.976530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.976534:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa80031000/0xec1488f14640df58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df5f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.976534:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759206.976538:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759206.976541:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa98db52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298368:0@lo:104: 00000100:00100000:2.0:1787759206.976551:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299136 00010000:00010000:0.0:1787759206.976553:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759206.976555:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299136 00010000:00010000:0.0:1787759206.976557:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.976561:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759206.976575:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299264 00000100:00100000:2.0:1787759206.976579:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787759206.976584:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+3:8438:x1874601334299136:12345-0@lo:104: 00000100:00100000:0.0:1787759206.976585:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299264 00010000:00010000:2.0:1787759206.976591:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.976611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759206.976619:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334299264:12345-0@lo:104: 00010000:00010000:0.0:1787759206.976626:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.976652:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759206.976661:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759206.976663:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334299136:12345-0@lo:104: Request processed in 75us (309us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759206.976690:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759206.976697:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:8438:x1874601334299264:12345-0@lo:104: Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759206.976699:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334299520:0@lo:103: 00000100:00100000:3.0:1787759206.976726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759206.976744:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759206.976774:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334298880:0@lo:103: 00000100:00100000:3.0:1787759206.976794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759206.976833:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab46252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299008:0@lo:103: 00000100:00100000:3.0:1787759206.976857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759206.976873:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759206.976878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f9816370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299392:0@lo:103: 00000100:00100000:3.0:1787759206.976895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759206.976923:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759206.976928:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334298624 00000100:00100000:3.0:1787759206.976933:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334298624 00010000:00010000:3.0:1787759206.976955:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 19 pid: 5828 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.976958:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334299136:0@lo:104: 00000100:00100000:1.0:1787759206.976966:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334299264:0@lo:104: 00000100:00100000:3.0:1787759206.976971:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299520 00000100:00100000:3.0:1787759206.976973:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299520 00000100:00100000:0.0:1787759206.976977:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787759206.976987:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 20 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977000:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787759206.977001:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334298880 00000100:00100000:3.0:1787759206.977006:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334298880 00010000:00010000:0.0:1787759206.977008:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977015:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977018:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151ac00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:0.0:1787759206.977025:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977025:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299008 00000100:00100000:3.0:1787759206.977028:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299008 00010000:00010000:3.0:1787759206.977035:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 22 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977037:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977043:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299392 00000100:00100000:3.0:1787759206.977046:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299392 10000000:00010000:0.0:1787759206.977052:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977053:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 23 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759206.977069:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759206.977071:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759206.977078:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+23:3303:x1874601334298624:12345-0@lo:103: 00010000:00010000:3.0:1787759206.977092:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759206.977097:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 23 pid: 5828 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977101:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977110:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 23 pid: 5828 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977123:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c7800/0xec1488f14640dfc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640dfba expref: 23 pid: 5828 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977135:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759206.977170:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4626580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+22:3303:x1874601334298624:12345-0@lo:103: Request processed in 92us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759206.977183:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787759206.977186:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787759206.977199:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787759206.977205:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977206:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+21:3303:x1874601334299520:12345-0@lo:103: 00000100:00100000:1.0:1787759206.977214:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334299648:0@lo:103: 00010000:00010000:3.0:1787759206.977214:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759206.977220:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977230:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151ac00/0xec1488f14640df04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640df0b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977235:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977248:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759206.977251:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168e600/0xec1488f14640df5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640df58 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977254:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.977255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759206.977267:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759206.977268:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168f800 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:0.0:1787759206.977273:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977282:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977290:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+20:3303:x1874601334299520:12345-0@lo:103: Request processed in 83us (562us total) trans 0 rc 0/0 10000000:00010000:0.0:1787759206.977292:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759206.977301:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759206.977311:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759206.977324:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299648 00000100:00100000:3.0:1787759206.977327:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299648 00010000:00010000:0.0:1787759206.977332:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977340:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759206.977359:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.977366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299776:0@lo:103: 00010000:00010000:0.0:1787759206.977368:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8168f800/0xec1488f14640deda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640dee1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.977393:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.977398:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759206.977398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759206.977423:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 20 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.977434:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299776 00000100:00100000:0.0:1787759206.977440:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299776 00000100:00100000:3.0:1787759206.977443:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759206.977451:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+21:3303:x1874601334298880:12345-0@lo:103: 00010000:00010000:0.0:1787759206.977459:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640deda expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977460:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759206.977468:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977480:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.977487:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787759206.977496:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151a200/0xec1488f14640df97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640df90 expref: 21 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.977500:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+21:3305:x1874601334299008:12345-0@lo:103: 00010000:00010000:3.0:1787759206.977512:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759206.977515:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759206.977521:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 20 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977532:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 20 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977539:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+20:3303:x1874601334298880:12345-0@lo:103: Request processed in 87us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759206.977549:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787759206.977551:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151aa00/0xec1488f14640df7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640df74 expref: 20 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977563:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759206.977565:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787759206.977572:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4625680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+18:3305:x1874601334299392:12345-0@lo:103: 00010000:00010000:3.0:1787759206.977580:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759206.977585:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.977598:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334298880:0@lo:103: 00000100:00100000:0.0:1787759206.977608:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46243c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+18:3305:x1874601334299008:12345-0@lo:103: Request processed in 111us (747us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759206.977612:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759206.977619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787759206.977630:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334299520:0@lo:103: 00010000:00010000:3.0:1787759206.977631:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c6600/0xec1488f14640df6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640df66 expref: 18 pid: 5826 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.977633:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab46252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299008:0@lo:103: 00000100:00100000:0.0:1787759206.977642:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787759206.977647:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759206.977656:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+16:3304:x1874601334299648:12345-0@lo:103: 00000100:00100000:2.0:1787759206.977665:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334298624:0@lo:103: 00010000:00010000:0.0:1787759206.977667:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759206.977676:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 16 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.977698:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4625680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+16:3305:x1874601334299392:12345-0@lo:103: Request processed in 124us (800us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759206.977702:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 16 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.977704:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f9816370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299392:0@lo:103: 00000100:00100000:3.0:1787759206.977708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1787759206.977729:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c6400/0xec1488f14640df0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640df04 expref: 15 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.977739:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759206.977780:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759206.977787:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759206.977799:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759206.977800:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+14:3304:x1874601334299648:12345-0@lo:103: Request processed in 145us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759206.977810:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+14:3305:x1874601334299776:12345-0@lo:103: 00000100:00100000:0.0:1787759206.977811:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787759206.977821:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759206.977826:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640deda expref: 14 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977834:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640deda expref: 14 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977844:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030a00/0xec1488f14640dee1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640deda expref: 14 pid: 5827 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759206.977853:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759206.977878:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c76850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+13:3305:x1874601334299776:12345-0@lo:103: Request processed in 72us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759206.977888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334299776:0@lo:103: 00000100:00100000:2.0:1787759206.977972:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334299648:0@lo:103: 00000100:00100000:1.0:1787759206.977973:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41db0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298496:192.168.204.9@tcp:104: 00000100:00100000:1.0:1787759206.977993:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1874601334298752:192.168.204.9@tcp:104: 00010000:00010000:1.0:1787759206.978033:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759206.978051:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759206.978230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759206.978273:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842368 00000100:00100000:1.0:1787759206.978278:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842368 00000100:00100000:0.0:1787759206.978284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00010000:00010000:1.0:1787759206.978298:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 10 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.978322:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842496 00000100:00100000:1.0:1787759206.978325:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842496 00000100:00100000:2.0:1787759206.978329:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 19 00010000:00010000:1.0:1787759206.978341:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 11 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.978341:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7004f5ce-d88c-4df1-9ee2-efe47130d121+11:2346:x1874601324842368:12345-192.168.204.9@tcp:103: 00010000:00010000:2.0:1787759206.978352:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759206.978359:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 11 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.978368:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 20 00010000:00010000:2.0:1787759206.978373:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 11 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.978383:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7004f5ce-d88c-4df1-9ee2-efe47130d121+11:2347:x1874601324842496:12345-192.168.204.9@tcp:103: 00010000:00010000:2.0:1787759206.978390:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c7a00/0xec1488f14640df3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef6171 expref: 11 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978392:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759206.978399:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 11 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.978405:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759206.978411:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 10 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978425:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c6200/0xec1488f14640df35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef616a expref: 10 pid: 5828 timeout: 213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759206.978437:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2346:x1874601324842368:12345-192.168.204.9@tcp:103: Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759206.978446:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 19 00010000:00010000:1.0:1787759206.978448:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978458:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978472:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978479:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978486:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978493:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978499:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168f600 already unused, calling callback (ffffffffc1462530) 00010000:00010000:1.0:1787759206.978503:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978511:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978528:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.978537:0:8438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759206.978540:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759206.978547:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.978555:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8168f600/0xec1488f14640dfe4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.978573:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:2347:x1874601324842496:12345-192.168.204.9@tcp:103: Request processed in 194us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759206.978586:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 20 00000100:00100000:0.0:1787759207.008862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759207.008914:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842624 00000100:00100000:3.0:1787759207.008924:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842624 00000100:00100000:3.0:1787759207.008985:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 124 00000100:00100000:3.0:1787759207.008996:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+8:5581:x1874601324842624:12345-192.168.204.9@tcp:101: 00010000:00010000:3.0:1787759207.009011:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759207.009034:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6600/0xec1488f14640dfeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef61d3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759207.009062:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6600/0xec1488f14640dfeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61d3 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759207.009075:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6600/0xec1488f14640dfeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61d3 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759207.009084:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6600, rc 0) 00000100:00100000:3.0:1787759207.009144:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324842624:12345-192.168.204.9@tcp:101: Request processed in 151us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759207.009151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 124 00000100:00100000:3.0:1787759207.011316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759207.011381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842752 00000100:00100000:1.0:1787759207.011389:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842752 00000100:00100000:1.0:1787759207.011659:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 125 00000100:00100000:1.0:1787759207.011673:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324842752:12345-192.168.204.9@tcp:501: 00000100:00100000:1.0:1787759207.012069:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324842752:12345-192.168.204.9@tcp:501: Request processed in 400us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.012077:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 125 00000100:00100000:0.0:1787759207.013003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759207.013068:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324842880 00000100:00100000:3.0:1787759207.013072:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324842880 00000100:00100000:3.0:1787759207.013205:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 126 00000100:00100000:3.0:1787759207.013212:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324842880:12345-192.168.204.9@tcp:503: 00000100:00100000:3.0:1787759207.013363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324842880:12345-192.168.204.9@tcp:503: Request processed in 151us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759207.013368:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 126 00000100:00100000:0.0:1787759207.015708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759207.015824:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843008 00000100:00100000:1.0:1787759207.015830:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843008 00000100:00100000:1.0:1787759207.015875:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 127 00000100:00100000:1.0:1787759207.015883:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:6045:x1874601324843008:12345-192.168.204.9@tcp:502: 00000100:00100000:1.0:1787759207.016096:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:6045:x1874601324843008:12345-192.168.204.9@tcp:502: Request processed in 213us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.016104:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 127 00000100:00100000:0.0:1787759207.017242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759207.017364:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843136 00000100:00100000:1.0:1787759207.017370:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843136 00000100:00100000:1.0:1787759207.017415:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 128 00000100:00100000:1.0:1787759207.017425:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:6045:x1874601324843136:12345-192.168.204.9@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787759207.017670:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:6045:x1874601324843136:12345-192.168.204.9@tcp:502:llog_process_th.0 Request processed in 247us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.017692:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 128 00000100:00100000:0.0:1787759207.019370:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759207.019409:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843264 00000100:00100000:1.0:1787759207.019416:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843264 00000100:00100000:1.0:1787759207.019464:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 129 00000100:00100000:1.0:1787759207.019484:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324843264:12345-192.168.204.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759207.019496:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759207.019513:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8168e600/0xec1488f14640dff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef61da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759207.019539:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8168e600/0xec1488f14640dff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61da expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759207.019547:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8168e600/0xec1488f14640dff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61da expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759207.019554:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8168e600, rc 0) 00000100:00100000:1.0:1787759207.019586:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324843264:12345-192.168.204.9@tcp:101:ll_cfg_requeue.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.019591:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 129 00000100:00100000:0.0:1787759207.020846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759207.020901:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843392 00000100:00100000:3.0:1787759207.020907:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843392 00000100:00100000:3.0:1787759207.020946:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 130 00000100:00100000:3.0:1787759207.020954:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324843392:12345-192.168.204.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759207.021199:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324843392:12345-192.168.204.9@tcp:501:ll_cfg_requeue.0 Request processed in 245us (356us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787759207.021208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 130 00010000:00010000:0.0:1787759207.596897:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759207.662252:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334299904:0@lo:400: 00000100:00100000:1.0:1787759207.662286:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334300288:0@lo:400: 00000100:00100000:3.0:1787759207.662338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759207.662388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759207.662428:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601334300416:0@lo:400: 00000100:00100000:3.0:1787759207.662478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759207.662483:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601334300160:0@lo:400: 00000100:00100000:1.0:1787759207.662541:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759207.662563:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334300032:0@lo:400: 00000100:00100000:1.0:1787759207.662589:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334300672:0@lo:13: 00000100:00100000:3.0:1787759207.662622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759207.662652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759207.662679:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334300544:0@lo:400: 00000100:00100000:1.0:1787759207.662743:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300288 00000100:00100000:3.0:1787759207.662793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759207.662798:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300288 00000100:00100000:3.0:1787759207.662854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300416 00000100:00100000:3.0:1787759207.662863:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300416 00000100:00100000:2.0:1787759207.662882:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300544 00000100:00100000:2.0:1787759207.662898:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300544 00000100:00100000:1.0:1787759207.662929:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759207.662946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300160 00000100:00100000:1.0:1787759207.662948:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334300288:12345-0@lo:400: 00000100:00100000:3.0:1787759207.662953:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300160 00000100:00100000:2.0:1787759207.662961:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787759207.662973:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334300544:12345-0@lo:400: 00000100:00100000:3.0:1787759207.662997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300032 00000100:00100000:3.0:1787759207.663002:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300032 00000100:00100000:3.0:1787759207.663034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759207.663049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601334300416:12345-0@lo:400: 00000100:00100000:1.0:1787759207.663056:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759207.663072:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601334300160:12345-0@lo:400: 00000100:00100000:0.0:1787759207.663100:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787759207.663100:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334300544:12345-0@lo:400: Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759207.663108:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4626580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601334300416:12345-0@lo:400: Request processed in 62us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759207.663116:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787759207.663118:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334300032:12345-0@lo:400: 00000100:00100000:3.0:1787759207.663126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787759207.663157:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601334300160:12345-0@lo:400: Request processed in 90us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.663168:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787759207.663175:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41db480 x1874601334300544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759207.663194:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334300032:12345-0@lo:400: Request processed in 79us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759207.663195:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334300544:0@lo:400: 00000100:00100000:0.0:1787759207.663211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759207.663217:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300672 00000100:00100000:1.0:1787759207.663225:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300672 00000100:00100000:1.0:1787759207.663288:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787759207.663302:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874601334300672:12345-0@lo:13: 00002000:00000024:1.0:1787759207.663342:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787759207.663407:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874601334300672:12345-0@lo:13: Request processed in 109us (758us total) trans 0 rc 0/0 00000100:00080000:3.0:1787759207.663407:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759207.663419:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759207.663420:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787759207.663445:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41db0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334300032:0@lo:400: 00000100:00100000:3.0:1787759207.663465:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601334300416:0@lo:400: 00000100:00100000:1.0:1787759207.663483:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334300288:12345-0@lo:400: Request processed in 541us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759207.663492:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787759207.663537:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41d92c0 x1874601334300288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759207.663547:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334300288:0@lo:400: 00000100:00100000:3.0:1787759207.663570:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601334300160:0@lo:400: 00010000:00080000:3.0:1787759207.663606:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fa8a2d4000 x1874601334300672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759207.663625:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334300672:0@lo:13: 00000100:00100000:3.0:1787759207.663660:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334299904 00000100:00100000:3.0:1787759207.663664:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334299904 00000100:00100000:3.0:1787759207.663837:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787759207.663848:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:3306:x1874601334299904:12345-0@lo:400: 00000100:00100000:3.0:1787759207.663913:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:3306:x1874601334299904:12345-0@lo:400: Request processed in 66us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759207.663922:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787759207.664197:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334299904:0@lo:400: 00000001:00100000:0.0:1787759207.694279:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6adecffe-4523-438b-8da7-1d705d9fa828 00000001:00080000:0.0:1787759207.694296:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787759208.309706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.309863:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.309918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759208.309922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843520 00000100:00100000:1.0:1787759208.309932:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843520 00000100:00100000:3.0:1787759208.309956:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843648 00000100:00100000:3.0:1787759208.309963:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843648 00000100:00100000:0.0:1787759208.309983:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759208.309990:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 132 00000100:00100000:1.0:1787759208.310004:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2346:x1874601324843520:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759208.310017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 16 00000100:00100000:3.0:1787759208.310028:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adecffe-4523-438b-8da7-1d705d9fa828+6:2347:x1874601324843648:12345-192.168.204.9@tcp:400:kworker.0 00000100:00080000:0.0:1787759208.310039:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759208.310062:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843776 00000100:00100000:0.0:1787759208.310067:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843776 00000100:00100000:1.0:1787759208.310077:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2346:x1874601324843520:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759208.310083:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 132 00000100:00100000:2.0:1787759208.310123:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324843904 00000100:00100000:2.0:1787759208.310129:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324843904 00000100:00100000:0.0:1787759208.310147:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 3 00000100:00100000:0.0:1787759208.310164:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+5:2346:x1874601324843776:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759208.310294:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6adecffe-4523-438b-8da7-1d705d9fa828+6:2347:x1874601324843648:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 267us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759208.310301:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 16 00000100:00100000:0.0:1787759208.310385:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+5:2346:x1874601324843776:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 222us (466us total) trans 0 rc 0/0 00000100:00080000:1.0:1787759208.310400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759208.310404:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759208.311033:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 4 00000100:00100000:2.0:1787759208.311044:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faadb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:2347:x1874601324843904:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:2.0:1787759208.311080:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faadb76d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:2347:x1874601324843904:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 40us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.311086:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 3 00000100:00100000:2.0:1787759208.311093:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 4 00000020:00000080:3.0:1787759208.371961:0:8493:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd2140c00 20000000:00000080:3.0:1787759208.371978:0:8493:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98fab3f61000 uarg=0000000000000000 20000000:01000000:3.0:1787759208.372006:0:8493:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787759208.372010:0:8493:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787759208.372014:0:8493:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787759208.372637:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787759208.372719:0:8493:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787759208.376646:0:8493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787759208.376732:0:8493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787759208.376822:0:8493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787759208.376840:0:8493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787759208.376860:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376878:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376886:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640de2b expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376893:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376902:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376909:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376946:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.376958:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 9 pid: 5827 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.376972:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334300800:192.168.204.9@tcp:104: 00010000:00010000:3.0:1787759208.377068:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.377075:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.377087:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4625680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334300928:0@lo:104: 00000100:00100000:3.0:1787759208.377120:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759208.377414:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.377423:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 11 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.377432:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334301056:0@lo:104: 00000100:00100000:3.0:1787759208.377455:0:8493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759208.377558:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.377566:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 11 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.377573:0:8493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334301184:0@lo:104: 00000100:00100000:3.0:1787759208.377589:0:8493:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f982597480 going to sleep for 11 seconds 00000100:00100000:2.0:1787759208.377675:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787759208.377694:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759208.377721:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334300928 00000100:00100000:2.0:1787759208.377727:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334300928 00000100:00100000:3.0:1787759208.377740:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301056 00000100:00100000:3.0:1787759208.377746:0:7626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301056 00000100:00100000:2.0:1787759208.377782:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301184 00000100:00100000:2.0:1787759208.377786:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301184 00000100:00100000:2.0:1787759208.377800:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787759208.377812:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:8493:x1874601334300928:12345-0@lo:104: 00000100:00100000:3.0:1787759208.377818:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787759208.377827:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.377829:0:7626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981637840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+5:8493:x1874601334301184:12345-0@lo:104: 00010000:00010000:3.0:1787759208.377839:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.377893:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759208.377899:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+5:8493:x1874601334300928:12345-0@lo:104: Request processed in 91us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759208.377905:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787759208.377922:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787759208.377927:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f98229c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8493:x1874601334301056:12345-0@lo:104: 00010000:00010000:2.0:1787759208.377934:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.377967:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787759208.377972:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f98229c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:8493:x1874601334301056:12345-0@lo:104: Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759208.377977:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787759208.377986:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787759208.378005:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378011:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787759208.378013:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c7000 already unused, calling callback (ffffffffc1a5dc20) 00010000:00010000:2.0:1787759208.378017:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787759208.378021:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378029:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8168ee00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:2.0:1787759208.378034:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759208.378046:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378046:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759208.378060:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787759208.378064:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759208.378069:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787759208.378073:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787759208.378103:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378110:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759208.378125:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378131:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8168ee00/0xec1488f14640de2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640de32 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378142:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759208.378144:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759208.378146:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759208.378156:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334301312:0@lo:103: 00000100:00100000:2.0:1787759208.378181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759208.378218:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301312 00000100:00100000:2.0:1787759208.378223:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301312 00010000:00010000:2.0:1787759208.378240:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759208.378265:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787759208.378273:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981634780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+12:3305:x1874601334301312:12345-0@lo:103: 00010000:00010000:3.0:1787759208.378281:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787759208.378283:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787759208.378290:0:7626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981637840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+3:8493:x1874601334301184:12345-0@lo:104: Request processed in 463us (594us total) trans 0 rc 0/0 00010000:00010000:2.0:1787759208.378292:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.378305:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759208.378320:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787759208.378328:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759208.378366:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4625680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334300928:0@lo:104: 00000100:00100000:0.0:1787759208.378383:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:1.0:1787759208.378407:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759208.378415:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759208.378421:0:6692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759208.378430:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759208.378430:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.378450:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c7c00 already unused, calling callback (ffffffffc1a5dc20) 00010000:00010000:1.0:1787759208.378450:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fac21c7000/0xec1488f14640def6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640defd expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759208.378456:0:6692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.378466:0:6692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759208.378466:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759208.378470:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759208.378473:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1787759208.378476:0:6692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759208.378483:0:6692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759208.378509:0:6692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.378515:0:6692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759208.378544:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759208.378556:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334301568:0@lo:103: 00010000:00010000:0.0:1787759208.378569:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640ddc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640ddd0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.378582:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759208.378583:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759208.378585:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759208.378666:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151b600/0xec1488f14640de32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640de2b expref: 12 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759208.378676:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981634780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:654ae17d-b69d-436d-8406-f726a2563564+11:3305:x1874601334301312:12345-0@lo:103: Request processed in 403us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759208.378678:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334301056:0@lo:104: 00000100:00100000:2.0:1787759208.378690:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759208.378698:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334301184:0@lo:104: 00000100:00100000:2.0:1787759208.378715:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334301440:0@lo:103: 00000100:00100000:3.0:1787759208.378734:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981636580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334301312:0@lo:103: 00000100:00100000:2.0:1787759208.378836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759208.378938:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301440 00000100:00100000:0.0:1787759208.378943:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301440 00010000:00010000:0.0:1787759208.378971:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759208.379002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787759208.379011:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816361c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+11:3306:x1874601334301440:12345-0@lo:103: 00010000:00010000:0.0:1787759208.379018:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759208.379022:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379031:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379042:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030800/0xec1488f14640defd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640def6 expref: 11 pid: 5828 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379052:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759208.379087:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816361c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:654ae17d-b69d-436d-8406-f726a2563564+10:3306:x1874601334301440:12345-0@lo:103: Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.379093:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787759208.379124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334301440:0@lo:103: 00000100:00100000:1.0:1787759208.379160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759208.379200:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301568 00000100:00100000:0.0:1787759208.379209:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301568 00010000:00010000:0.0:1787759208.379225:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 10 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759208.379261:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787759208.379269:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+10:3303:x1874601334301568:12345-0@lo:103: 00010000:00010000:0.0:1787759208.379276:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759208.379280:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 10 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379288:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 10 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379299:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80030e00/0xec1488f14640ddd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640ddc9 expref: 10 pid: 5826 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.379308:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759208.379345:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+9:3303:x1874601334301568:12345-0@lo:103: Request processed in 78us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.379351:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787759208.379412:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:654ae17d-b69d-436d-8406-f726a2563564:3303:1874601334301568:0@lo:103: 00000100:00100000:1.0:1787759208.380038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759208.380039:0:8493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8493:1874601334300800:192.168.204.9@tcp:104: 00010000:00010000:3.0:1787759208.380069:0:8493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759208.380076:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844032 00000100:00100000:2.0:1787759208.380082:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844032 00010000:00010000:2.0:1787759208.380103:0:6693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759208.380137:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 24 00000100:00100000:2.0:1787759208.380144:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2346:x1874601324844032:12345-192.168.204.9@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787759208.380153:0:6693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759208.380157:0:6693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380167:0:6693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380179:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa80031a00/0xec1488f14640df4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61a2 expref: 10 pid: 5827 timeout: 214 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380192:0:6693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380200:0:6693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380225:0:6693:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380233:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380239:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380246:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380251:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fac21c7800 already unused, calling callback (ffffffffc1462530) 00010000:00010000:2.0:1787759208.380255:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380262:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380281:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759208.380288:0:6693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759208.380317:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:2346:x1874601324844032:12345-192.168.204.9@tcp:103:ldlm_bl.0 Request processed in 175us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759208.380322:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 24 00010000:00010000:3.0:1787759208.380705:0:8493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.380715:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759208.380722:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fac21c7800/0xec1488f14640dff9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.621069:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759208.717054:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.717389:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844160 00000100:00100000:0.0:1787759208.717399:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844160 00000100:00100000:0.0:1787759208.717468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 133 00000100:00100000:0.0:1787759208.717480:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:5581:x1874601324844160:12345-192.168.204.9@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759208.717498:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759208.717515:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x261bc6ad56ef61e1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.717541:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.717561:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759208.717572:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8806ec00, rc 0) 00000100:00100000:0.0:1787759208.717639:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324844160:12345-192.168.204.9@tcp:101:ll_cfg_requeue.0 Request processed in 162us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.717659:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 133 00000100:00100000:0.0:1787759208.719712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.719742:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844288 00000100:00100000:0.0:1787759208.719777:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844288 00000100:00100000:0.0:1787759208.719934:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 134 00000100:00100000:0.0:1787759208.719946:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324844288:12345-192.168.204.9@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759208.720214:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324844288:12345-192.168.204.9@tcp:501:ll_cfg_requeue.0 Request processed in 271us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.720223:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 134 00000100:00100000:1.0:1787759208.721496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.721539:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844416 00000100:00100000:0.0:1787759208.721546:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844416 00000100:00100000:0.0:1787759208.721583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 135 00000100:00100000:0.0:1787759208.721599:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324844416:12345-192.168.204.9@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759208.722148:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:5581:x1874601324844416:12345-192.168.204.9@tcp:503:ll_cfg_requeue.0 Request processed in 552us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.722157:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 135 00000100:00100000:2.0:1787759208.725078:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.725187:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844544 00000100:00100000:0.0:1787759208.725196:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844544 00000100:00100000:0.0:1787759208.725348:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 136 00000100:00100000:0.0:1787759208.725374:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:6103:x1874601324844544:12345-192.168.204.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787759208.725871:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:6103:x1874601324844544:12345-192.168.204.9@tcp:502:llog_process_th.0 Request processed in 503us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.725881:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 136 00000100:00100000:2.0:1787759208.727185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759208.727319:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844672 00000100:00100000:0.0:1787759208.727326:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844672 00000100:00100000:0.0:1787759208.727365:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 137 00000100:00100000:0.0:1787759208.727377:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:6103:x1874601324844672:12345-192.168.204.9@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787759208.727605:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:6103:x1874601324844672:12345-192.168.204.9@tcp:502:llog_process_th.0 Request processed in 231us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759208.727614:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 137 10000000:01000000:1.0:1787759209.132878:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787759209.132886:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fab41b2800 from 39 10000000:01000000:1.0:1787759209.132891:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787759209.132938:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.132950:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.132963:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.132986:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301696:0@lo:101: 00000100:00100000:1.0:1787759209.133053:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.133133:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.133419:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301696 00000100:00100000:0.0:1787759209.133427:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301696 00000100:00100000:0.0:1787759209.133499:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787759209.133512:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+9:5830:x1874601334301696:12345-0@lo:101: 00010000:00010000:0.0:1787759209.133525:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759209.133538:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8806e000/0xec1488f14640e00e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e007 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.133563:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8806e000/0xec1488f14640e00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e007 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.133585:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8806e000/0xec1488f14640e00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e007 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.133595:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8806e000, rc 0) 00000100:00100000:0.0:1787759209.133659:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334301696:12345-0@lo:101: Request processed in 151us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.133681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787759209.133699:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301696:0@lo:101: 00010000:00010000:1.0:1787759209.133715:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.133726:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.133796:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301824:0@lo:501: 00000100:00100000:1.0:1787759209.133823:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.133849:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.133919:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301824 00000100:00100000:0.0:1787759209.133923:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301824 00000100:00100000:0.0:1787759209.133946:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787759209.133951:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334301824:12345-0@lo:501: 00000100:00100000:0.0:1787759209.134195:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334301824:12345-0@lo:501: Request processed in 242us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.134203:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787759209.134691:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301824:0@lo:501: 00000100:00100000:1.0:1787759209.134723:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301952:0@lo:503: 00000100:00100000:1.0:1787759209.134779:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.134809:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab43640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.134934:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334301952 00000100:00100000:0.0:1787759209.134938:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334301952 00000100:00100000:0.0:1787759209.134961:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787759209.134965:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334301952:12345-0@lo:503: 00000100:00100000:0.0:1787759209.135235:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334301952:12345-0@lo:503: Request processed in 269us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.135240:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787759209.135279:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334301952:0@lo:503: 00000100:00100000:1.0:1787759209.135717:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8572:1874601334302080:0@lo:502: 00000100:00100000:1.0:1787759209.135781:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.135868:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.135950:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302080 00000100:00100000:0.0:1787759209.135955:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302080 00000100:00100000:0.0:1787759209.135986:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787759209.135993:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:8572:x1874601334302080:12345-0@lo:502: 00000100:00100000:0.0:1787759209.136302:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:8572:x1874601334302080:12345-0@lo:502: Request processed in 305us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.136309:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787759209.136331:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8572:1874601334302080:0@lo:502: 00000100:00100000:1.0:1787759209.136371:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8572:1874601334302208:0@lo:502: 00000100:00100000:1.0:1787759209.136405:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.136427:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.136440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302208 00000100:00100000:0.0:1787759209.136444:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302208 00000100:00100000:0.0:1787759209.136469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787759209.136475:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:8572:x1874601334302208:12345-0@lo:502: 00000100:00100000:0.0:1787759209.136599:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+10:8572:x1874601334302208:12345-0@lo:502: Request processed in 124us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.136606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787759209.136650:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8572:1874601334302208:0@lo:502: 00000040:00080000:1.0:1787759209.136677:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787759209.136777:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787759209.136909:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759209.136916:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.136924:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fab4289a00/0xec1488f14640e007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e00e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759209.136931:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787759209.136932:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787759209.136934:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787759209.136952:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.136957:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.136963:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759209.136971:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302336:0@lo:101: 00000100:00100000:0.0:1787759209.136990:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.137011:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.137046:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302336 00000100:00100000:3.0:1787759209.137052:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302336 00000100:00100000:3.0:1787759209.137133:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787759209.137143:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+10:5830:x1874601334302336:12345-0@lo:101: 00010000:00010000:3.0:1787759209.137152:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759209.137163:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6e00/0xec1488f14640e01c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e015 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.137192:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6e00/0xec1488f14640e01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e015 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.137201:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6e00/0xec1488f14640e01c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e015 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.137208:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6e00, rc 0) 00000100:00100000:3.0:1787759209.137237:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302336:12345-0@lo:101: Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.137241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787759209.137264:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302336:0@lo:101: 00010000:00010000:0.0:1787759209.137273:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.137288:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759209.137319:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302464:0@lo:501: 00000100:00100000:0.0:1787759209.137337:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.137354:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.137376:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302464 00000100:00100000:1.0:1787759209.137380:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302464 00000100:00100000:1.0:1787759209.137405:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787759209.137413:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302464:12345-0@lo:501: 00000100:00100000:1.0:1787759209.137585:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302464:12345-0@lo:501: Request processed in 173us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.137592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787759209.137615:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302464:0@lo:501: 00000100:00100000:0.0:1787759209.137648:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302592:0@lo:503: 00000100:00100000:0.0:1787759209.137681:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.137697:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca000 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.137722:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302592 00000100:00100000:3.0:1787759209.137727:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302592 00000100:00100000:3.0:1787759209.137773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787759209.137780:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302592:12345-0@lo:503: 00000100:00100000:3.0:1787759209.137992:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302592:12345-0@lo:503: Request processed in 211us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.137999:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787759209.138024:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302592:0@lo:503: 00000100:00100000:0.0:1787759209.138385:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8573:1874601334302720:0@lo:502: 00000100:00100000:0.0:1787759209.138425:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.138451:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.138465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302720 00000100:00100000:1.0:1787759209.138471:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302720 00000100:00100000:1.0:1787759209.138510:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787759209.138517:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:8573:x1874601334302720:12345-0@lo:502: 00000100:00100000:1.0:1787759209.138706:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:8573:x1874601334302720:12345-0@lo:502: Request processed in 189us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.138713:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787759209.138776:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8573:1874601334302720:0@lo:502: 00000020:01000000:0.0:1787759209.138800:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759209.138806:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759209.138808:0:8573:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787759209.138814:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787759209.138841:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8573:1874601334302848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759209.138874:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.138902:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.138965:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302848 00000100:00100000:3.0:1787759209.138970:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302848 00000100:00100000:3.0:1787759209.138996:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787759209.139001:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:8573:x1874601334302848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.139118:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+11:8573:x1874601334302848:12345-0@lo:502:llog_process_th.0 Request processed in 115us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.139125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787759209.139161:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8573:1874601334302848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759209.139181:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759209.139198:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759209.139200:0:8573:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787759209.139205:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787759209.139273:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787759209.139293:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787759209.139299:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.139306:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806e800/0xec1488f14640e015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e01c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759209.139311:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787759209.139313:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fab41b2800 from 4 10000000:01000000:1.0:1787759209.139314:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787759209.139330:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.139337:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.139344:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.139357:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.139390:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.139404:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.139425:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334302976 00000100:00100000:0.0:1787759209.139431:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334302976 00000100:00100000:0.0:1787759209.139461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787759209.139471:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+11:5830:x1874601334302976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759209.139483:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759209.139493:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e023 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.139508:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e023 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.139515:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e023 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.139521:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8806f400, rc 0) 00000100:00100000:0.0:1787759209.139551:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334302976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.139558:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787759209.139578:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334302976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759209.139591:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.139610:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.139660:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.139685:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.139739:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303104 00000100:00100000:2.0:1787759209.139743:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303104 00000100:00100000:1.0:1787759209.139744:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.139798:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787759209.139804:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334303104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.139976:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334303104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.139983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787759209.140087:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.140121:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.140155:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.140184:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.140321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303232 00000100:00100000:0.0:1787759209.140326:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303232 00000100:00100000:0.0:1787759209.140361:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787759209.140369:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334303232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.140513:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334303232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.140521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787759209.140902:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.142587:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8574:1874601334303360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.142666:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.142708:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364540 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.143495:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303360 00000100:00100000:3.0:1787759209.143505:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303360 00000100:00100000:3.0:1787759209.143570:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787759209.143581:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:8574:x1874601334303360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.143888:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:8574:x1874601334303360:12345-0@lo:502:llog_process_th.0 Request processed in 309us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.143897:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787759209.143928:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8574:1874601334303360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759209.143964:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759209.143977:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759209.143979:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787759209.143986:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fab41b2800 00000020:00000080:1.0:1787759209.143988:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787759209.144068:0:8574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8574:1874601334303488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.144106:0:8574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.144143:0:8574:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364540 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.144193:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303488 00000100:00100000:2.0:1787759209.144198:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303488 00000100:00100000:2.0:1787759209.144232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787759209.144240:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:8574:x1874601334303488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.144382:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+12:8574:x1874601334303488:12345-0@lo:502:llog_process_th.0 Request processed in 143us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.144390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787759209.144399:0:8574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8574:1874601334303488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759209.144430:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759209.144435:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759209.144436:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787759209.144440:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787759209.144527:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787759209.144552:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759209.144562:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.144573:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759209.144583:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787759209.144586:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa82f2f000 from 39 10000000:01000000:2.0:1787759209.144589:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787759209.144612:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.144620:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.144654:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.144670:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.144701:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.144843:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.145001:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303616 00000100:00100000:3.0:1787759209.145006:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303616 00000100:00100000:3.0:1787759209.145033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787759209.145042:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+12:5830:x1874601334303616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759209.145051:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759209.145136:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6a00/0xec1488f14640e038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e031 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.145161:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6a00/0xec1488f14640e038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e031 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.145173:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6a00/0xec1488f14640e038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e031 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.145181:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6a00, rc 0) 00000100:00100000:3.0:1787759209.145261:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334303616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.145267:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787759209.145319:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.145331:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.145341:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.145386:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.145410:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.145463:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.145501:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303744 00000100:00100000:3.0:1787759209.145506:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303744 00000100:00100000:3.0:1787759209.145574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787759209.145582:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334303744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.146044:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334303744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 462us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.146060:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787759209.146192:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.146224:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.146263:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.146295:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.146347:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334303872 00000100:00100000:3.0:1787759209.146352:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334303872 00000100:00100000:3.0:1787759209.146385:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787759209.146392:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334303872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.146592:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334303872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.146598:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787759209.146850:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334303872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.147116:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8575:1874601334304000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.147153:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.147178:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364480 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.147188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304000 00000100:00100000:3.0:1787759209.147193:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304000 00000100:00100000:3.0:1787759209.147225:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787759209.147232:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:8575:x1874601334304000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.147412:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:8575:x1874601334304000:12345-0@lo:502:llog_process_th.0 Request processed in 179us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.147419:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787759209.147626:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8575:1874601334304000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.147683:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8575:1874601334304128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.147719:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.147736:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364480 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.147855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304128 00000100:00100000:3.0:1787759209.147859:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304128 00000100:00100000:3.0:1787759209.147894:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787759209.147902:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:8575:x1874601334304128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.148041:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+13:8575:x1874601334304128:12345-0@lo:502:llog_process_th.0 Request processed in 140us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.148048:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787759209.148075:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8575:1874601334304128:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787759209.148103:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787759209.148160:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787759209.148180:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787759209.148190:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.148202:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151ba00/0xec1488f14640e031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e038 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759209.148271:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787759209.148274:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787759209.148277:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787759209.148300:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.148308:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.148328:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.148342:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.148374:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.148402:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.148461:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304256 00000100:00100000:3.0:1787759209.148466:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304256 00000100:00100000:3.0:1787759209.148504:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787759209.148512:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+13:5830:x1874601334304256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759209.148528:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759209.148541:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c7800/0xec1488f14640e046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e03f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.148562:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7800/0xec1488f14640e046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e03f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.148572:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c7800/0xec1488f14640e046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e03f expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.148581:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c7800, rc 0) 00000100:00100000:3.0:1787759209.148617:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.148631:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787759209.148677:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759209.148691:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e046 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.148700:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e046 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759209.148746:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.148797:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.148811:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa88066900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.148824:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304384 00000100:00100000:3.0:1787759209.148827:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304384 00000100:00100000:3.0:1787759209.148851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787759209.148858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.149100:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.149108:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787759209.149143:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.149172:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.149217:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.149246:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa88066900 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.149387:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304512 00000100:00100000:1.0:1787759209.149391:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304512 00000100:00100000:1.0:1787759209.149424:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787759209.149433:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.149907:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 474us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.149915:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787759209.149937:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab46243c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.151186:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8578:1874601334304640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.151227:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.151256:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364480 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.151266:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304640 00000100:00100000:0.0:1787759209.151272:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304640 00000100:00100000:0.0:1787759209.151311:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787759209.151323:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:8578:x1874601334304640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759209.151524:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:8578:x1874601334304640:12345-0@lo:502:llog_process_th.0 Request processed in 204us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.151531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787759209.151559:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8578:1874601334304640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759209.151589:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759209.151597:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759209.151600:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787759209.151606:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787759209.151654:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8578:1874601334304768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.151697:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.151721:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364480 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.151748:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304768 00000100:00100000:0.0:1787759209.151770:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304768 00000100:00100000:0.0:1787759209.151815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787759209.151832:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:8578:x1874601334304768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759209.152027:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+14:8578:x1874601334304768:12345-0@lo:502:llog_process_th.0 Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.152041:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787759209.152342:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8578:1874601334304768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759209.152376:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759209.152382:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759209.152384:0:8578:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787759209.152388:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787759209.152482:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787759209.152506:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787759209.152515:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e046 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.152525:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fab4289c00/0xec1488f14640e03f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e046 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759209.152537:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787759209.152540:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa82f2f000 from 4 10000000:01000000:0.0:1787759209.152543:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787759209.152564:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.152582:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.152591:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759209.152606:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.152651:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.152688:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.152740:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334304896 00000100:00100000:1.0:1787759209.152744:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334304896 00000100:00100000:1.0:1787759209.152809:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787759209.152818:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+14:5830:x1874601334304896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759209.152828:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759209.152846:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e04d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.152867:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e04d expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.152876:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e04d expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.152884:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fab4289400, rc 0) 00000100:00100000:1.0:1787759209.152924:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334304896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.152930:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787759209.153010:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb76580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334304896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.153032:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.153042:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.153094:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.153431:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.153458:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.153472:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305024 00000100:00100000:0.0:1787759209.153478:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305024 00000100:00100000:0.0:1787759209.153512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787759209.153520:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334305024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.153782:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334305024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.153790:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787759209.153836:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.153867:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.153908:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.153939:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.153992:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305152 00000100:00100000:3.0:1787759209.153998:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305152 00000100:00100000:3.0:1787759209.154036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787759209.154046:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334305152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.154195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334305152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.154204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787759209.154221:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.154518:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8581:1874601334305280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759209.154554:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.154568:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa88cbc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.154589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305280 00000100:00100000:3.0:1787759209.154594:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305280 00000100:00100000:3.0:1787759209.154619:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787759209.154949:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:8581:x1874601334305280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.155257:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:8581:x1874601334305280:12345-0@lo:502:llog_process_th.0 Request processed in 631us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.155265:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787759209.155300:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8581:1874601334305280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759209.155337:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759209.155346:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759209.155349:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787759209.155358:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fa82f2f000 00000020:00000080:0.0:1787759209.155362:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787759209.155908:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8581:1874601334305408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759209.155945:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.155974:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fac15ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759209.155981:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305408 00000100:00100000:3.0:1787759209.155987:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305408 00000100:00100000:3.0:1787759209.156024:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787759209.156032:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:8581:x1874601334305408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.156169:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+15:8581:x1874601334305408:12345-0@lo:502:llog_process_th.0 Request processed in 138us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759209.156177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787759209.156196:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb74780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8581:1874601334305408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759209.156222:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759209.156227:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759209.156229:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787759209.156235:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787759209.156289:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787759209.156313:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759209.156323:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.156333:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759209.156342:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787759209.156345:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98fa851c2800 from 39 10000000:01000000:3.0:1787759209.156348:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759209.156369:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.156377:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.156385:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759209.156399:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.156430:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.156454:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa880669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.156473:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305536 00000100:00100000:0.0:1787759209.156478:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305536 00000100:00100000:0.0:1787759209.156506:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787759209.156516:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+15:5830:x1874601334305536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759209.156525:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759209.156545:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8806ee00/0xec1488f14640e062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e05b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.156567:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8806ee00/0xec1488f14640e062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e05b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.156578:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8806ee00/0xec1488f14640e062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e05b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759209.156588:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8806ee00, rc 0) 00000100:00100000:0.0:1787759209.156623:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334305536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.156628:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787759209.156663:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759209.156676:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e062 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759209.156691:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e062 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759209.156915:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.156944:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759209.156971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305664 00000100:00100000:3.0:1787759209.156973:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa880669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.156977:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305664 00000100:00100000:0.0:1787759209.157013:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787759209.157023:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334305664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.157244:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334305664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.157252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787759209.157271:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.157299:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.157339:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.157360:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa880669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759209.157377:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305792 00000100:00100000:0.0:1787759209.157383:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305792 00000100:00100000:0.0:1787759209.157413:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787759209.157424:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334305792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759209.157679:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334305792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759209.157687:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787759209.157722:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334305792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759209.158506:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8582:1874601334305920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.158550:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.158581:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa86496480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.158587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334305920 00000100:00100000:1.0:1787759209.158593:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334305920 00000100:00100000:1.0:1787759209.158628:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787759209.158649:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:8582:x1874601334305920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.158933:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:8582:x1874601334305920:12345-0@lo:502:llog_process_th.0 Request processed in 297us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.158950:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787759209.158963:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8582:1874601334305920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.159081:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8582:1874601334306048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759209.159120:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759209.159146:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fa880669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.159159:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306048 00000100:00100000:1.0:1787759209.159164:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306048 00000100:00100000:1.0:1787759209.159195:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787759209.159202:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:8582:x1874601334306048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759209.159411:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:8582:x1874601334306048:12345-0@lo:502:llog_process_th.0 Request processed in 197us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.159418:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787759209.159424:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4626d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8582:1874601334306048:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787759209.159448:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787759209.159529:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787759209.159550:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787759209.159557:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e062 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.159566:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fac21c7c00/0xec1488f14640e05b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e062 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759209.159575:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787759209.159577:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787759209.159580:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787759209.159601:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.159609:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.159618:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.159632:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.159684:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.159703:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364540 going to sleep for 11 seconds 00000100:00100000:1.0:1787759209.159719:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306176 00000100:00100000:1.0:1787759209.159722:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306176 00000100:00100000:1.0:1787759209.160232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787759209.160241:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334306176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759209.160249:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759209.160261:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fab4288000/0xec1488f14640e070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e069 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.160282:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fab4288000/0xec1488f14640e070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e069 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.160293:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fab4288000/0xec1488f14640e070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e069 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.160301:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fab4288000, rc 0) 00000100:00100000:1.0:1787759209.160338:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759209.160345:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787759209.160376:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759209.160386:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e070 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.160394:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e070 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759209.160449:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759209.160484:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759209.160515:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab4364540 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.160529:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306304 00000100:00100000:2.0:1787759209.160535:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306304 00000100:00100000:2.0:1787759209.160577:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787759209.160585:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.161283:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 697us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.161292:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787759209.161330:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.161364:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.161410:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.161437:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.161453:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306432 00000100:00100000:2.0:1787759209.161457:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306432 00000100:00100000:2.0:1787759209.161489:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787759209.161497:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.161964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 467us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.161980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787759209.162024:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.162186:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8585:1874601334306560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.162228:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.162251:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306560 00000100:00100000:2.0:1787759209.162254:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306560 00000100:00100000:2.0:1787759209.162281:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787759209.162290:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:8585:x1874601334306560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.162675:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:8585:x1874601334306560:12345-0@lo:502:llog_process_th.0 Request processed in 386us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.162682:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787759209.162726:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.162740:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8585:1874601334306560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759209.162788:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759209.162798:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759209.162800:0:8585:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787759209.162808:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787759209.162831:0:8585:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8585:1874601334306688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.162873:0:8585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.162895:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306688 00000100:00100000:2.0:1787759209.162899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306688 00000100:00100000:2.0:1787759209.162922:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787759209.162930:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+17:8585:x1874601334306688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.163105:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+17:8585:x1874601334306688:12345-0@lo:502:llog_process_th.0 Request processed in 176us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.163123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787759209.163170:0:8585:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.163185:0:8585:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8585:1874601334306688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759209.163207:0:8585:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759209.163211:0:8585:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759209.163213:0:8585:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787759209.163217:0:8585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787759209.163266:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787759209.163283:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787759209.163291:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e070 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163301:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fab4288800/0xec1488f14640e069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e070 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759209.163311:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759209.163313:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa851c2800 from 4 10000000:01000000:2.0:1787759209.163316:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759209.163336:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163345:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163354:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.163366:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.163425:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.163446:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.163460:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306816 00000100:00100000:2.0:1787759209.163464:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306816 00000100:00100000:2.0:1787759209.163487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787759209.163494:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334306816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.163502:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759209.163512:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e077 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163530:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e077 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163540:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e077 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163548:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151b800, rc 0) 00000100:00100000:2.0:1787759209.163575:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334306816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.163581:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787759209.163608:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.163621:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.163630:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.163679:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.163704:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.163722:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.163734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334306944 00000100:00100000:2.0:1787759209.163737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334306944 00000100:00100000:2.0:1787759209.163781:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787759209.163790:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334306944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.163968:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334306944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.163976:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787759209.164009:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334306944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.164035:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.164073:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.164091:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.164102:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307072 00000100:00100000:2.0:1787759209.164105:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307072 00000100:00100000:2.0:1787759209.164126:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787759209.164134:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334307072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.164263:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334307072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.164270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787759209.164307:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.164469:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8587:1874601334307200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.164500:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.164517:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307200 00000100:00100000:2.0:1787759209.164521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307200 00000100:00100000:2.0:1787759209.164542:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787759209.164548:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:8587:x1874601334307200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.164733:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:8587:x1874601334307200:12345-0@lo:502:llog_process_th.0 Request processed in 184us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.164740:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787759209.164839:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.164853:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8587:1874601334307200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759209.164877:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759209.164884:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759209.164886:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787759209.164894:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98fa851c2800 00000020:00000080:2.0:1787759209.164898:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787759209.164969:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8587:1874601334307328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.165004:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.165021:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307328 00000100:00100000:2.0:1787759209.165024:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307328 00000100:00100000:2.0:1787759209.165048:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787759209.165055:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:8587:x1874601334307328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759209.165213:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:8587:x1874601334307328:12345-0@lo:502:llog_process_th.0 Request processed in 159us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.165220:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787759209.165255:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.165269:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:654ae17d-b69d-436d-8406-f726a2563564:8587:1874601334307328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759209.165294:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759209.165299:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759209.165301:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787759209.165305:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787759209.165354:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787759209.165381:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759209.165388:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165397:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759209.165406:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787759209.165409:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98fa9a7c0000 from 1 10000000:01000000:2.0:1787759209.165411:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787759209.165429:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165437:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165446:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.165459:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.165486:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.165499:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.165511:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307456 00000100:00100000:2.0:1787759209.165514:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307456 00000100:00100000:2.0:1787759209.165536:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787759209.165544:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334307456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.165551:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759209.165561:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fa8151a600/0xec1488f14640e08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e085 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165590:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151a600/0xec1488f14640e08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e085 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165600:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fa8151a600/0xec1488f14640e08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e085 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165609:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fa8151a600, rc 0) 00000100:00100000:2.0:1787759209.165654:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334307456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759209.165660:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787759209.165690:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759209.165699:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e08c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.165708:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e08c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759209.165743:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.165798:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759209.165822:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98fab510b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759209.165837:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307584 00000100:00100000:2.0:1787759209.165840:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307584 00000100:00100000:2.0:1787759209.165869:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787759209.165877:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334307584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759209.166049:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa863d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334307584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (251us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759209.166068:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787759209.166102:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981634b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334307584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787759209.166123:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787759209.166129:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e08c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759209.166137:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151ae00/0xec1488f14640e085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e08c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759209.645005:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759210.668879:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759210.830244:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787759211.694807:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759211.756914:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787759211.756949:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334307712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759211.757046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759211.757149:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307712 00000100:00100000:3.0:1787759211.757158:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307712 00000100:00100000:3.0:1787759211.757239:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759211.757258:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334307712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759211.757297:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787759211.757416:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab4624b40 x1874601334307712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759211.757437:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab4624b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334307712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759211.758272:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334307712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1013us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759211.758284:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787759211.758313:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787759212.718417:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759212.736273:0:9040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing yml_node 00000100:00100000:0.0:1787759212.783172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759212.783261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759212.783451:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307840 00000100:00100000:0.0:1787759212.783459:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307840 00000100:00100000:0.0:1787759212.783526:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787759212.783549:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faadb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334307840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759212.783592:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759212.783699:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faadb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334307840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759212.783715:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787759212.783741:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787759212.783795:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faadb77840 x1874601334307840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759212.783806:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787759212.783827:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334307840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759212.785256:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334307968:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759212.785334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601334308480:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759212.785378:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787759212.785383:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334308352:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759212.785427:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334308096:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759212.785470:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759212.785475:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334308224:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759212.785522:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334307968 00000100:00100000:1.0:1787759212.785527:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334307968 00000100:00100000:1.0:1787759212.785559:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787759212.785579:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:3306:x1874601334307968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785619:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:3306:x1874601334307968:12345-0@lo:400:kworker.0 Request processed in 52us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759212.785626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787759212.785656:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308480 00000100:00100000:1.0:1787759212.785659:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308480 00000100:00100000:1.0:1787759212.785698:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308096 00000100:00100000:1.0:1787759212.785701:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308096 00000100:00100000:1.0:1787759212.785714:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308224 00000100:00100000:1.0:1787759212.785716:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308224 00000100:00100000:1.0:1787759212.785732:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787759212.785737:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601334308480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785786:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601334308480:12345-0@lo:400:kworker.0 Request processed in 49us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759212.785793:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787759212.785804:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787759212.785811:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334308096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785840:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334308096:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759212.785845:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787759212.785856:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787759212.785862:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334308224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785889:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334308224:12345-0@lo:400:kworker.0 Request processed in 28us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759212.785896:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787759212.785914:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308352 00000100:00100000:1.0:1787759212.785918:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308352 00000100:00100000:1.0:1787759212.785943:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787759212.785949:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334308352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.785977:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334308352:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759212.785983:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787759212.786004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759212.786315:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334308224:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.786325:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334308096:0@lo:400:kworker.0 00010000:00080000:1.0:1787759212.786349:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41dad00 x1874601334308352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759212.786359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334308352:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.786368:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334307968:0@lo:400:kworker.0 00000100:00100000:1.0:1787759212.786378:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601334308480:0@lo:400:kworker.0 00000100:00100000:3.0:1787759213.429391:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759213.429422:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759213.429441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759213.429456:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844800 00000100:00100000:2.0:1787759213.429465:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844800 00000100:00100000:2.0:1787759213.429509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 186 00000100:00100000:3.0:1787759213.429520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759213.429521:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2347:x1874601324844800:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:1.0:1787759213.429540:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324844928 00000100:00100000:1.0:1787759213.429547:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324844928 00000100:00100000:0.0:1787759213.429596:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845056 00000100:00100000:0.0:1787759213.429602:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845056 00000100:00100000:2.0:1787759213.429603:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2347:x1874601324844800:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759213.429620:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 186 00000100:00100000:0.0:1787759213.429651:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845184 00000100:00100000:0.0:1787759213.429655:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845184 00000100:00100000:2.0:1787759213.429663:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 6 00000100:00100000:2.0:1787759213.429685:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4626d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:2347:x1874601324845056:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:1.0:1787759213.429688:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 20 00000100:00100000:0.0:1787759213.429697:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 7 00000100:00100000:1.0:1787759213.429716:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adecffe-4523-438b-8da7-1d705d9fa828+6:2346:x1874601324844928:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:0.0:1787759213.429717:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4625680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+5:2346:x1874601324845184:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759213.429732:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787759213.429741:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787759213.429779:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4626d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6adecffe-4523-438b-8da7-1d705d9fa828+5:2347:x1874601324845056:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 65us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759213.429788:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 6 00000100:00100000:1.0:1787759213.429798:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6adecffe-4523-438b-8da7-1d705d9fa828+6:2346:x1874601324844928:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 90us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759213.429805:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4625680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+5:2346:x1874601324845184:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759213.429813:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 20 00000100:00100000:0.0:1787759213.429818:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 7 00000100:00080000:1.0:1787759213.429839:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759213.429844:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787759213.429849:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787759213.740993:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759214.584823:0:9234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00010000:00010000:1.0:1787759214.765264:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759215.666356:0:9331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:0.0:1787759215.788913:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787759216.702068:0:9428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:2.0:1787759216.813049:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759216.877022:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787759216.877059:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334308608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759216.877168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759216.877241:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308608 00000100:00100000:2.0:1787759216.877264:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308608 00000100:00080000:1.0:1787759216.877316:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759216.877353:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759216.877369:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601334308608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759216.877410:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759216.877507:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601334308608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759216.877518:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787759216.877551:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faadb77c00 x1874601334308608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759216.877587:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334308608:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787759217.323323:0:9476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: runtests ============----- Wed Aug 26 11:46:56 EDT 2026 00010000:00010000:1.0:1787759217.837883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759217.901212:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759217.901253:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334308736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759217.901329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759217.902728:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308736 00000100:00100000:3.0:1787759217.902737:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308736 00000100:00100000:3.0:1787759217.902934:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759217.902949:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334308736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759217.902989:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759217.903056:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334308736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759217.903065:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787759217.903094:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787759217.903312:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faadb743c0 x1874601334308736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759217.903347:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334308736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759217.904405:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334308864:0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.904418:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334309120:0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.904452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759217.904464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759217.904491:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601334309376:0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.904517:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334308992:0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.904542:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308864 00000100:00100000:1.0:1787759217.904547:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308864 00000100:00100000:1.0:1787759217.904591:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787759217.904600:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:3305:x1874601334308864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.904644:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:3305:x1874601334308864:12345-0@lo:400:kworker.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759217.904650:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787759217.904725:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334309248:0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.904781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759217.904860:0:7621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309248 00000100:00100000:1.0:1787759217.904861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759217.904867:0:7621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309248 00000100:00100000:1.0:1787759217.904913:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334308864:0@lo:400:kworker.0 00000100:00100000:2.0:1787759217.904920:0:7621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787759217.904933:0:7621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601334309248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.904939:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309120 00000100:00100000:3.0:1787759217.904945:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309120 00000100:00100000:1.0:1787759217.904946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309376 00000100:00100000:1.0:1787759217.904951:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309376 00000100:00100000:2.0:1787759217.904993:0:7621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601334309248:12345-0@lo:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759217.905005:0:7621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787759217.905006:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787759217.905015:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787759217.905021:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab4624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334309120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759217.905026:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601334309376:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787759217.905047:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41d8780 x1874601334309248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759217.905060:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601334309248:0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.905077:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab4624b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874601334309120:12345-0@lo:400:kworker.0 Request processed in 60us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759217.905082:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601334309376:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759217.905084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787759217.905101:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787759217.905115:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759217.905131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759217.905193:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334308992 00000100:00100000:3.0:1787759217.905196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334308992 00000100:00100000:3.0:1787759217.905222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787759217.905231:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab46243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334308992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.905271:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab46243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601334308992:12345-0@lo:400:kworker.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759217.905282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601334309376:0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.905282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787759217.905327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601334308992:0@lo:400:kworker.0 00000100:00100000:3.0:1787759217.905438:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874601334309120:0@lo:400:kworker.0 00000100:00100000:3.0:1787759218.548723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759218.548789:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759218.548811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845312 00000100:00100000:3.0:1787759218.548818:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759218.548825:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845312 00000100:00100000:3.0:1787759218.548867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759218.548876:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845440 00000100:00100000:1.0:1787759218.548887:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845440 00000100:00100000:3.0:1787759218.548894:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845696 00000100:00100000:3.0:1787759218.548900:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845696 00000100:00100000:2.0:1787759218.548924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 188 00000100:00100000:2.0:1787759218.548940:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2348:x1874601324845312:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759218.548963:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845568 00000100:00100000:1.0:1787759218.548969:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 24 00000100:00100000:3.0:1787759218.548969:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845568 00000100:00100000:0.0:1787759218.548989:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 9 00000100:00100000:1.0:1787759218.548991:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adecffe-4523-438b-8da7-1d705d9fa828+6:2349:x1874601324845440:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:0.0:1787759218.549012:0:9196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6adecffe-4523-438b-8da7-1d705d9fa828+5:2349:x1874601324845696:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759218.549022:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 10 00000100:00100000:3.0:1787759218.549047:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:2348:x1874601324845568:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:2.0:1787759218.549068:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2348:x1874601324845312:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759218.549082:0:9196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6adecffe-4523-438b-8da7-1d705d9fa828+5:2349:x1874601324845696:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759218.549084:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adecffe-4523-438b-8da7-1d705d9fa828+6:2349:x1874601324845440:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759218.549092:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:2348:x1874601324845568:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 54us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759218.549099:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 188 00000100:00100000:0.0:1787759218.549130:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 9 00000100:00100000:1.0:1787759218.549130:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 24 00000100:00100000:3.0:1787759218.549149:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 10 00000100:00080000:3.0:1787759218.549202:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759218.549207:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759218.549211:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787759218.861116:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759219.884848:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759220.908974:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759221.932899:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759221.997012:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759221.997038:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334309504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759221.997111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759221.997170:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309504 00000100:00100000:2.0:1787759221.997180:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309504 00000100:00080000:0.0:1787759221.997243:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759221.997279:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787759221.997294:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334309504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759221.997327:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759221.997383:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334309504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759221.997406:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787759221.997462:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41d8780 x1874601334309504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759221.997513:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334309504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787759222.956887:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759223.020889:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334309632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759223.020957:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759223.020990:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309632 00000100:00100000:2.0:1787759223.020998:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309632 00000100:00100000:2.0:1787759223.021061:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787759223.021074:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334309632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787759223.021110:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759223.021168:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334309632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759223.021178:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787759223.021204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787759223.021223:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334309760:0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759223.021297:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334309888:0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021318:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601334310272:0@lo:400:kworker.0 00000100:00100000:3.0:1787759223.021328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759223.021353:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759223.021359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759223.021362:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334310016:0@lo:400:kworker.0 00000100:00100000:3.0:1787759223.021403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759223.021423:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309888 00000100:00100000:1.0:1787759223.021428:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309888 00000100:00100000:3.0:1787759223.021464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310272 00000100:00100000:1.0:1787759223.021466:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310016 00000100:00100000:3.0:1787759223.021468:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310272 00000100:00100000:1.0:1787759223.021470:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310016 00000100:00100000:2.0:1787759223.021481:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334309760 00000100:00100000:2.0:1787759223.021487:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334309760 00000100:00100000:1.0:1787759223.021507:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787759223.021514:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787759223.021516:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334309888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759223.021528:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601334310272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021533:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787759223.021543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:3304:x1874601334309760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759223.021558:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601334309888:12345-0@lo:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759223.021564:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787759223.021582:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759223.021588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981636580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601334310272:12345-0@lo:400:kworker.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759223.021592:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334310016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021593:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:3304:x1874601334309760:12345-0@lo:400:kworker.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759223.021600:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787759223.021606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787759223.021636:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601334310016:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00080000:2.0:1787759223.021646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759223.021653:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787759223.021658:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334310144:0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759223.021709:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601334310016:0@lo:400:kworker.0 00000100:00100000:1.0:1787759223.021729:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601334309888:0@lo:400:kworker.0 00010000:00080000:2.0:1787759223.021729:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faadb74b40 x1874601334309632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759223.021798:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334309632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759223.021803:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310144 00000100:00100000:1.0:1787759223.021808:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310144 00000100:00080000:2.0:1787759223.021832:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759223.021859:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601334310272:0@lo:400:kworker.0 00000100:00100000:1.0:1787759223.021861:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787759223.021876:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334310144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759223.021881:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa99cbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334309760:0@lo:400:kworker.0 00000100:00100000:1.0:1787759223.021932:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334310144:12345-0@lo:400:kworker.0 Request processed in 59us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759223.021941:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787759223.021944:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faae547c00 x1874601334310144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759223.021956:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334310144:0@lo:400:kworker.0 00000001:02000400:0.0:1787759223.053234:0:10204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 00000001:02000400:3.0:1787759223.512800:0:10253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === runtests: start setup 11:47:02 (1787759222) === 00000100:00100000:3.0:1787759223.668656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759223.668716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759223.668728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845952 00000100:00100000:0.0:1787759223.668738:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845952 00000100:00100000:2.0:1787759223.668778:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324845824 00000100:00100000:2.0:1787759223.668782:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324845824 00000100:00100000:3.0:1787759223.668783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759223.668823:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846208 00000100:00100000:1.0:1787759223.668829:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846208 00000100:00100000:2.0:1787759223.668834:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 190 00000100:00100000:3.0:1787759223.668844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759223.668850:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2348:x1874601324845824:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:0.0:1787759223.668854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 28 00000100:00100000:1.0:1787759223.668870:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846080 00000100:00100000:1.0:1787759223.668875:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846080 00000100:00100000:0.0:1787759223.668880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae5443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adecffe-4523-438b-8da7-1d705d9fa828+6:2349:x1874601324845952:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759223.668885:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 12 00000100:00100000:3.0:1787759223.668899:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adecffe-4523-438b-8da7-1d705d9fa828+5:2349:x1874601324846208:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:1.0:1787759223.668911:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 13 00000100:00100000:1.0:1787759223.668923:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:2348:x1874601324846080:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:2.0:1787759223.668941:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2348:x1874601324845824:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759223.668943:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6adecffe-4523-438b-8da7-1d705d9fa828+5:2349:x1874601324846208:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759223.668953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae5443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6adecffe-4523-438b-8da7-1d705d9fa828+6:2349:x1874601324845952:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 86us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759223.668959:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 190 00000100:00100000:3.0:1787759223.668961:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 12 00000100:00100000:1.0:1787759223.668963:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae545a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6adecffe-4523-438b-8da7-1d705d9fa828+5:2348:x1874601324846080:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759223.668973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 28 00000100:00100000:1.0:1787759223.668978:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 13 00000100:00080000:3.0:1787759223.669018:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759223.669024:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759223.669028:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787759223.981823:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759225.004841:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759225.139473:0:10445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787759226.028902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759227.053897:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759227.117884:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334310400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759227.117947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759227.117985:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310400 00000100:00100000:2.0:1787759227.117997:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310400 00000100:00080000:3.0:1787759227.118036:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759227.118073:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787759227.118085:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334310400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759227.118123:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759227.118189:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601334310400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759227.118195:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787759227.118235:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98fab41da1c0 x1874601334310400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759227.118261:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601334310400:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787759228.076832:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759228.140955:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334310528:0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141014:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98f981636d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787759228.141020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759228.141064:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334311040:0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141068:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759228.141092:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae5470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601334311168:0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759228.141125:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759228.141129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759228.141132:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae5452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601334310912:0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787759228.141163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759228.141168:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae5461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334310784:0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141199:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759228.141200:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311168 00000100:00100000:1.0:1787759228.141209:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311168 00000100:00100000:2.0:1787759228.141224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334311296:0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141231:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310528 00000100:00100000:3.0:1787759228.141235:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310528 00000100:00100000:2.0:1787759228.141257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759228.141281:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787759228.141285:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310912 00000100:00100000:1.0:1787759228.141290:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310912 00000100:00100000:3.0:1787759228.141292:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:3306:x1874601334310528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141313:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311040 00000100:00100000:2.0:1787759228.141319:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311040 00000100:00100000:3.0:1787759228.141339:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8639e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:3306:x1874601334310528:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759228.141345:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787759228.141358:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311296 00000100:00100000:2.0:1787759228.141361:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311296 00000100:00100000:1.0:1787759228.141374:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310784 00000100:00100000:3.0:1787759228.141377:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334310656 00000100:00100000:1.0:1787759228.141380:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310784 00000100:00100000:3.0:1787759228.141381:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334310656 00000100:00100000:2.0:1787759228.141395:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787759228.141403:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334311040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141411:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759228.141420:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f9816370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334310656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759228.141442:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759228.141451:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae544b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601334311040:12345-0@lo:400:kworker.0 Request processed in 48us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759228.141457:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787759228.141461:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759228.141470:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601334311168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.141480:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787759228.141486:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f9816370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334310656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759228.141491:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601334311296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141497:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759228.141520:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981637c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601334311168:12345-0@lo:400:kworker.0 Request processed in 52us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759228.141529:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334311296:12345-0@lo:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759228.141530:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759228.141539:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759228.141544:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787759228.141544:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601334310912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759228.141569:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787759228.141579:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa99cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334310784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141582:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601334310912:12345-0@lo:400:kworker.0 Request processed in 43us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759228.141589:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787759228.141600:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faae546d00 x1874601334311296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759228.141613:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae546d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334311296:0@lo:400:kworker.0 00000100:00100000:1.0:1787759228.141622:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa99cbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601334310784:12345-0@lo:400:kworker.0 Request processed in 44us (421us total) trans 0 rc 0/0 00010000:00080000:2.0:1787759228.141627:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98f981636d00 x1874601334310656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759228.141635:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787759228.141640:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98f981636d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759228.141651:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae5470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601334311168:0@lo:400:kworker.0 00000100:00080000:1.0:1787759228.141664:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759228.141670:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759228.141686:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae5461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601334310784:0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141703:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae5452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601334310912:0@lo:400:kworker.0 00000100:00100000:3.0:1787759228.141712:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae545e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334310528:0@lo:400:kworker.0 00010000:00080000:3.0:1787759228.141722:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faae546580 x1874601334311040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759228.141738:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601334311040:0@lo:400:kworker.0 00000100:00100000:2.0:1787759228.788562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759228.788601:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846336 00000100:00100000:3.0:1787759228.788609:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846336 00000100:00100000:2.0:1787759228.788646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:3.0:1787759228.788659:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 192 00000100:00100000:3.0:1787759228.788668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2347:x1874601324846336:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:1.0:1787759228.788698:0:8202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846464 00000100:00100000:1.0:1787759228.788704:0:8202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846464 00000100:00080000:2.0:1787759228.788781:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759228.788788:0:8202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 32 00000100:00100000:3.0:1787759228.788795:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2347:x1874601324846336:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 127us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759228.788801:0:8202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98f981636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adecffe-4523-438b-8da7-1d705d9fa828+6:2347:x1874601324846464:12345-192.168.204.9@tcp:400:kworker.0 00000100:00100000:3.0:1787759228.788806:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 192 00000100:00100000:1.0:1787759228.788835:0:8202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98f981636d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6adecffe-4523-438b-8da7-1d705d9fa828+6:2347:x1874601324846464:12345-192.168.204.9@tcp:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759228.788840:0:8202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 32 00000100:00100000:2.0:1787759228.791635:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:2.0:1787759228.791661:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:0.0:1787759228.791675:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846592 00000100:00100000:0.0:1787759228.791686:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846592 00000100:00100000:3.0:1787759228.791702:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846720 00000100:00100000:3.0:1787759228.791707:0:9196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846720 00000100:00100000:0.0:1787759228.791742:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 10 00000100:00100000:3.0:1787759228.791774:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 11 00000100:00080000:2.0:1787759228.791775:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787759228.791779:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+5:2345:x1874601324846592:12345-192.168.204.9@tcp:9:kworker.0 00000100:00080000:2.0:1787759228.791790:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759228.791791:0:9196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6adecffe-4523-438b-8da7-1d705d9fa828+5:2345:x1874601324846720:12345-192.168.204.9@tcp:9:kworker.0 00000020:00000080:0.0:1787759228.791810:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xec1488f14640dfc8 00000020:00000080:3.0:1787759228.791815:0:9196:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xec1488f14640dfcf 00000100:00080000:0.0:1787759228.791819:0:6678:0:(import.c:65:import_set_state_nolock()) ffff98fabcbc7800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787759228.791824:0:9196:0:(import.c:65:import_set_state_nolock()) ffff98f981d17000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787759228.791856:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787759228.791860:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787759228.791861:0:9196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787759228.791866:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759228.792311:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6adecffe-4523-438b-8da7-1d705d9fa828+2:2345:x1874601324846592:12345-192.168.204.9@tcp:9:kworker.0 Request processed in 560us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759228.792315:0:9196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6adecffe-4523-438b-8da7-1d705d9fa828+2:2345:x1874601324846720:12345-192.168.204.9@tcp:9:kworker.0 Request processed in 528us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759228.792327:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 10 00000100:00100000:3.0:1787759228.792335:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 11 00010000:00010000:1.0:1787759229.100841:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787759230.007942:0:11142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787759230.124872:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787759230.977830:0:11289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff79ddc930 20000000:00000080:0.0:1787759230.977844:0:11289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98f981d48c00 uarg=0000000000000000 20000000:01000000:0.0:1787759230.977876:0:11289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787759230.977887:0:11289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787759230.977892:0:11289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787759230.978329:0:11290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787759230.978386:0:11289:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787759230.981089:0:11289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787759230.981107:0:11289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981121:0:11289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981127:0:11289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e023 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981131:0:11289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e04d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981135:0:11289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e077 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981139:0:11289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981169:0:11289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.981179:0:11289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 18 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981189:0:11289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311424:0@lo:104: 00000100:00100000:2.0:1787759230.981251:0:11289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759230.981294:0:11289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.981299:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311424 00000100:00100000:3.0:1787759230.981307:0:7626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311424 00010000:00010000:2.0:1787759230.981308:0:11289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 18 pid: 5827 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981317:0:11289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311552:0@lo:104: 00000100:00100000:2.0:1787759230.981337:0:11289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759230.981359:0:7626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311552 00000100:00100000:3.0:1787759230.981363:0:7626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311552 00010000:00010000:2.0:1787759230.981374:0:11289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759230.981381:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787759230.981383:0:11289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 18 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981393:0:11289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311680:0@lo:104: 00000100:00100000:1.0:1787759230.981394:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787759230.981399:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:11289:x1874601334311424:12345-0@lo:104: 00000100:00100000:1.0:1787759230.981411:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:11289:x1874601334311552:12345-0@lo:104: 00010000:00010000:0.0:1787759230.981414:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981424:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981425:0:11289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759230.981461:0:11289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.981462:0:7626:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1787759230.981474:0:7626:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1787759230.981481:0:11289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 9 pid: 5828 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981490:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787759230.981494:0:11289:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311808:192.168.204.9@tcp:104: 00010000:00010000:1.0:1787759230.981496:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759230.981501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:654ae17d-b69d-436d-8406-f726a2563564+4:11289:x1874601334311424:12345-0@lo:104: Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759230.981511:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:654ae17d-b69d-436d-8406-f726a2563564+4:11289:x1874601334311552:12345-0@lo:104: Request processed in 105us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759230.981517:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759230.981524:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787759230.981539:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311680 00000100:00100000:0.0:1787759230.981544:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311680 00010000:00010000:1.0:1787759230.981555:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787759230.981563:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.981567:0:7626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787759230.981577:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151b200 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:1.0:1787759230.981582:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981584:0:7627:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787759230.981588:0:7626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+3:11289:x1874601334311680:12345-0@lo:104: 00010000:00010000:0.0:1787759230.981593:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981596:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759230.981611:0:7626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787759230.981613:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981615:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8806fc00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:0.0:1787759230.981623:0:7627:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981623:0:11289:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae291000 going to sleep for 11 seconds 10000000:01000000:1.0:1787759230.981631:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759230.981641:0:7627:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.981645:0:11289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311424:0@lo:104: 10000000:00010000:0.0:1787759230.981655:0:7627:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759230.981662:0:7627:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787759230.981664:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981669:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759230.981672:0:11289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311552:0@lo:104: 00010000:00010000:3.0:1787759230.981678:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759230.981683:0:11289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311680:0@lo:104: 00000100:00100000:3.0:1787759230.981689:0:7626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:654ae17d-b69d-436d-8406-f726a2563564+3:11289:x1874601334311680:12345-0@lo:104: Request processed in 108us (265us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759230.981691:0:7627:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981693:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981709:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8151b200/0xec1488f14640e077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e07e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981712:0:7627:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759230.981726:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981728:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787759230.981732:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981741:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fa8806fc00/0xec1488f14640e04d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e054 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981775:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fab4288e00 already unused, calling callback (ffffffffc1a5dc20) 10000000:00010000:1.0:1787759230.981780:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.981784:0:7626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787759230.981786:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759230.981792:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759230.981793:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.981798:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1787759230.981800:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759230.981805:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787759230.981823:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981826:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759230.981832:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759230.981844:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.981855:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.109@tcp lock: ffff98fab4288e00/0xec1488f14640e023 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xec1488f14640e02a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759230.981863:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334312064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759230.981868:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759230.981882:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334312192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787759230.981884:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759230.981888:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759230.981892:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759230.981899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759230.981915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334311936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759230.981923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759230.981953:0:7628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312064 00000100:00100000:1.0:1787759230.981954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759230.981960:0:7628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312064 00000100:00100000:3.0:1787759230.981980:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312192 00010000:00010000:0.0:1787759230.981983:0:7628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 19 pid: 5827 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.981986:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312192 00000100:00100000:2.0:1787759230.981991:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334311936 00000100:00100000:2.0:1787759230.981996:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334311936 00010000:00010000:2.0:1787759230.982013:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 21 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759230.982016:0:7628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787759230.982026:0:7628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88c75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:654ae17d-b69d-436d-8406-f726a2563564+21:3306:x1874601334312064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759230.982037:0:7628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759230.982041:0:7628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 21 pid: 5827 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.982052:0:7628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 21 pid: 5827 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.982059:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787759230.982071:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fab41da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+21:3305:x1874601334311936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759230.982081:0:7628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fab4289400/0xec1488f14640e054 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640e04d expref: 21 pid: 5827 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.982082:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759230.982082:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 21 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.982091:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 21 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.982117:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 20 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759230.982117:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759230.982129:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faae544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+20:3304:x1874601334312192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759230.982131:0:7628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759230.982136:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151b800/0xec1488f14640e07e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640e077 expref: 20 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759230.982137:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759230.982143:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 20 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759230.982155:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 19 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759230.982161:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759230.982167:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8806f400/0xec1488f14640e02a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xec1488f14640e023 expref: 19 pid: 5826 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759230.982170:0:7628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88c75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:654ae17d-b69d-436d-8406-f726a2563564+19:3306:x1874601334312064:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759230.982179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:654ae17d-b69d-436d-8406-f726a2563564:3306:1874601334312064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759230.982183:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759230.982188:0:7628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787759230.982228:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fab41da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:654ae17d-b69d-436d-8406-f726a2563564+17:3305:x1874601334311936:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759230.982236:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787759230.982237:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:654ae17d-b69d-436d-8406-f726a2563564:3305:1874601334311936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759230.982242:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faae544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:654ae17d-b69d-436d-8406-f726a2563564+17:3304:x1874601334312192:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759230.982256:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759230.982287:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fab41da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:654ae17d-b69d-436d-8406-f726a2563564:3304:1874601334312192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759230.982476:0:11289:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11289:1874601334311808:192.168.204.9@tcp:104: 00010000:00010000:0.0:1787759230.982496:0:11289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759230.982653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.9@tcp (source: 12345-192.168.204.9@tcp) 00000100:00100000:1.0:1787759230.982679:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601324846848 00000100:00100000:1.0:1787759230.982683:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601324846848 00010000:00010000:1.0:1787759230.982696:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759230.982713:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.9@tcp, seq: 28 00000100:00100000:1.0:1787759230.982717:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa8a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7004f5ce-d88c-4df1-9ee2-efe47130d121+10:2347:x1874601324846848:12345-192.168.204.9@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787759230.982723:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759230.982726:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982732:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982741:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8806ec00/0xec1488f14640e000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.9@tcp remote: 0x261bc6ad56ef61e1 expref: 10 pid: 5828 timeout: 237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982774:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982783:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982795:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982802:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982808:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982820:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982825:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98fa8151a400 already unused, calling callback (ffffffffc1462530) 00010000:00010000:1.0:1787759230.982829:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982836:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982851:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759230.982860:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759230.982873:0:11289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759230.982883:0:11289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759230.982887:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa8a31d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7004f5ce-d88c-4df1-9ee2-efe47130d121+9:2347:x1874601324846848:12345-192.168.204.9@tcp:103:ldlm_bl.0 Request processed in 167us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759230.982899:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.9@tcp, seq: 28 00010000:00010000:0.0:1787759230.982900:0:11289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98fa8151a400/0xec1488f14640e093 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759231.148868:0:6692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759231.980428:0:11484:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg409-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787759232.108804:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787759232.108810:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fab41b2800 from 7 10000000:01000000:0.0:1787759232.108813:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787759232.108849:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759232.108858:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759232.108876:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759232.108916:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787759232.108970:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759232.109020:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae52e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.109020:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312320 00000100:00100000:3.0:1787759232.109028:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312320 00000100:00100000:3.0:1787759232.109078:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787759232.109089:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+16:5830:x1874601334312320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759232.109099:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759232.109109:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c7a00/0xec1488f14640e0a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e09a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.109126:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7a00/0xec1488f14640e0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e09a expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.109134:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c7a00/0xec1488f14640e0a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e09a expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.109141:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c7a00, rc 0) 00000100:00100000:3.0:1787759232.109178:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.109182:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787759232.109229:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759232.109241:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759232.109248:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e0a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759232.109288:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759232.109306:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759232.109320:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae52e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.109345:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312448 00000100:00100000:3.0:1787759232.109349:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312448 00000100:00100000:3.0:1787759232.109367:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787759232.109374:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.109582:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.109592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787759232.109607:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759232.109639:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759232.109672:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759232.109683:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98faae52e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.109707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312576 00000100:00100000:3.0:1787759232.109712:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312576 00000100:00100000:3.0:1787759232.109729:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787759232.109734:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.109859:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.109867:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787759232.109893:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faadb77c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787759232.110490:0:11499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787759232.110547:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787759232.110567:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759232.110574:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.110587:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8806e200/0xec1488f14640e09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759232.110594:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759232.110595:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa82f2f000 from 7 10000000:01000000:2.0:1787759232.110597:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759232.110615:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.110620:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.110625:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759232.110633:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.110654:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.110675:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.110704:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312704 00000100:00100000:3.0:1787759232.110708:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312704 00000100:00100000:3.0:1787759232.110727:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787759232.110732:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+17:5830:x1874601334312704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759232.110737:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759232.110743:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c6200/0xec1488f14640e0af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e0a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.110771:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c6200/0xec1488f14640e0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e0a8 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.110780:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c6200/0xec1488f14640e0af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e0a8 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.110787:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c6200, rc 0) 00000100:00100000:3.0:1787759232.110821:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334312704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.110827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787759232.110854:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759232.110865:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.110872:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e0af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759232.110908:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.110929:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.110952:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.110963:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312832 00000100:00100000:3.0:1787759232.110974:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312832 00000100:00100000:3.0:1787759232.110999:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787759232.111005:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334312832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.111096:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334312832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.111102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787759232.111120:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.111140:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.111164:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.111176:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.111207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334312960 00000100:00100000:3.0:1787759232.111212:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334312960 00000100:00100000:3.0:1787759232.111229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787759232.111234:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334312960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.111308:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334312960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.111316:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787759232.111330:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334312960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787759232.111812:0:11500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787759232.111855:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787759232.111864:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759232.111868:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.111873:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151aa00/0xec1488f14640e0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0af expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759232.111879:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759232.111880:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98fa851c2800 from 7 10000000:01000000:2.0:1787759232.111881:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759232.111890:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.111895:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.111899:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759232.111906:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.111922:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.111942:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.111959:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334313088 00000100:00100000:3.0:1787759232.111964:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334313088 00000100:00100000:3.0:1787759232.111989:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787759232.111996:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+18:5830:x1874601334313088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759232.112001:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759232.112007:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98fac21c7000/0xec1488f14640e0bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xec1488f14640e0b6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.112016:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98fac21c7000/0xec1488f14640e0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xec1488f14640e0b6 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.112022:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98fac21c7000/0xec1488f14640e0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xec1488f14640e0b6 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759232.112026:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98fac21c7000, rc 0) 00000100:00100000:3.0:1787759232.112055:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334313088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.112059:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787759232.112080:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759232.112087:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.112092:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xec1488f14640e0bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759232.112121:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.112136:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.112148:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.112166:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334313216 00000100:00100000:3.0:1787759232.112171:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334313216 00000100:00100000:3.0:1787759232.112203:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787759232.112211:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334313216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.112299:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334313216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.112307:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787759232.112325:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.112342:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759232.112364:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759232.112375:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff98f981cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787759232.112385:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334313344 00000100:00100000:3.0:1787759232.112389:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334313344 00000100:00100000:3.0:1787759232.112412:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1787759232.112420:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334313344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759232.112491:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98fa88d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:654ae17d-b69d-436d-8406-f726a2563564+19:5830:x1874601334313344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759232.112496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787759232.112511:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98fa8a31cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:654ae17d-b69d-436d-8406-f726a2563564:5830:1874601334313344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787759232.112970:0:11501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787759232.113009:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787759232.113018:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.109@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759232.113021:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759232.113027:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.109@tcp lock: ffff98fa8151a200/0xec1488f14640e0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xec1488f14640e0bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759232.172911:0:7627:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759232.236924:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787759232.236944:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98faae547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334313472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759232.237009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759232.237048:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601334313472 00000100:00100000:3.0:1787759232.237054:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601334313472 00000100:00080000:1.0:1787759232.237090:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787759232.237130:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787759232.237139:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98faadb77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334313472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759232.237165:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759232.237220:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98faadb77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601334313472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759232.237226:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787759232.237261:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98faae547840 x1874601334313472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759232.237276:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98faae547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601334313472:0@lo:13:osp-pre-0-0.0 Debug log: 6517 lines, 6517 kept, 0 dropped, 0 bad.