00000001:02000400:2.0F:1787827083.470765:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787827090.938153:0:3489:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787827091.784670:0:3552:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1551 MB/s 00000001:01000000:0.0:1787827092.034843:0:3552:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1919 MB/s 00000001:01000000:0.0:1787827092.284434:0:3552:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 11135 MB/s 00000020:02000000:2.0:1787827092.521420:0:3582:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_65_g89f8e4a 00000400:02000000:3.0F:1787827092.834732:0:3597:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.129@tcp [8/256/0/180] 00008000:02000000:1.0F:1787827095.079191:0:3749:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787827116.553542:0:5712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787827121.779876:0:6461:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787827121.779884:0:6461:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787827121.779886:0:6461:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787827121.780114:0:6461:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e602e2f6 00000080:02000400:0.0:1787827121.780126:0:6461:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787827121.785242:0:6461:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787827121.785252:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787827121.785279:0:6461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e83d5f28) 00000020:00000080:0.0:1787827121.785351:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787827121.811185:0:6461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787827121.811275:0:6461:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1787827121.823904:0:6461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787827121.824114:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787827121.824120:0:6461:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787827121.824130:0:6461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd5cf 00000020:01000004:3.0:1787827121.824134:0:6461:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787827121.824137:0:6461:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787827121.824141:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e602e2f6 from MGS 00000020:01000004:3.0:1787827121.824144:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787827121.824157:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006691f3b2) 00000020:00000080:3.0:1787827121.824167:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787827121.824263:0:6461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e602e2f6 from MGS, refs=2 00080000:01000000:3.0:1787827121.824269:0:6461:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787827121.824275:0:6461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd5dd 00000100:00100000:3.0:1787827121.824351:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787827121.824685:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787827121.824692:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787827121.825146:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787827121.825154:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787827121.825892:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787827121.826051:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787827121.826056:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787827121.826606:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787827121.826613:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787827121.827057:0:6461:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787827121.827063:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787827121.828077:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827121.828081:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827121.828083:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827121.828357:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827121.828360:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827121.828361:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827121.829181:0:6461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787827121.830513:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787827122.078618:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6000 MB/s 00000001:01000000:1.0:1787827122.328498:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7679 MB/s 00000001:01000000:1.0:1787827122.578937:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1319 MB/s 00000001:01000000:1.0:1787827122.828447:0:6461:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1667 MB/s 00080000:10000000:1.0:1787827122.832552:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1787827122.838603:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787827122.839917:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787827122.840401:0:6475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787827122.840473:0:6461:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787827122.840503:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787827122.840623:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787827122.840646:0:6461:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787827122.841084:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787827122.841326:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787827122.841333:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787827122.841863:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787827122.841871:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787827122.842823:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787827122.842831:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787827122.844091:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787827122.844110:0:6461:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:3.0:1787827122.844112:0:6461:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787827122.844149:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:3.0:1787827122.844164:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (00000000c9dcd597) 00000020:00000080:3.0:1787827122.844178:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787827122.844267:0:6461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000da3c8b52@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787827122.844469:0:6461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:3.0:1787827122.844477:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787827122.844741:0:6481:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787827122.844765:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid a7d14451-881f-46a5-81e7-5eca8cfcf000) 00000020:00000080:3.0:1787827122.844780:0:6461:0:(genops.c:1385:class_connect()) connect: client a7d14451-881f-46a5-81e7-5eca8cfcf000, cookie 0xb2e8bd65d71dd5eb 00000100:00080000:3.0:1787827122.844790:0:6461:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827122.844795:0:6461:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import 00000000da3c8b52 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787827122.844823:0:6461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009a29dc9f x1874672580821120/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827122.844886:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a7d14451-881f-46a5-81e7-5eca8cfcf000:3612:1874672580821120:0@lo:250: 00000100:00100000:3.0:1787827122.844972:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827122.845035:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821120 00000100:00100000:3.0:1787827122.845042:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821120 00000100:00100000:3.0:1787827122.845070:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827122.845077:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c58fc2fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3612:x1874672580821120:12345-0@lo:250: 00010000:00080000:3.0:1787827122.845096:0:6476:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7d14451-881f-46a5-81e7-5eca8cfcf000@0@lo t0 exp 0000000000000000 cur 75 last 0 00000020:00000080:3.0:1787827122.845115:0:6476:0:(genops.c:1385:class_connect()) connect: client a7d14451-881f-46a5-81e7-5eca8cfcf000, cookie 0xb2e8bd65d71dd5f2 00000100:00080000:3.0:1787827122.845230:0:6476:0:(import.c:65:import_set_state_nolock()) 00000000ca3952ab : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827122.845294:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c58fc2fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:3612:x1874672580821120:12345-0@lo:250: Request processed in 216us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827122.845302:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827122.845345:0:3612:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787827122.845352:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:3.0:1787827122.845358:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787827122.845362:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787827122.845365:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000da3c8b52 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787827122.845368:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787827122.845371:0:3612:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787827122.845375:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a7d14451-881f-46a5-81e7-5eca8cfcf000:3612:1874672580821120:0@lo:250: 00000100:00080000:3.0:1787827122.845432:0:6461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a7d14451-881f-46a5-81e7-5eca8cfcf000->MGS 00000020:01000004:3.0:1787827122.845456:0:6461:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787827122.845461:0:6461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787827122.845471:0:6461:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005fdc170b) 00000020:00000080:3.0:1787827122.845480:0:6461:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1787827122.847084:0:6480:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787827122.851968:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.852128:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787827122.852134:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787827122.852622:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787827122.852628:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787827122.852809:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787827122.852815:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787827122.853672:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.853892:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787827122.853897:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787827122.854440:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787827122.854447:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787827122.883832:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.884028:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787827122.884033:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787827122.884957:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787827122.884965:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787827122.885682:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.885846:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787827122.885851:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787827122.886622:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787827122.886630:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787827122.887816:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.887955:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787827122.887961:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787827122.889085:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787827122.889094:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787827122.890250:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.890404:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787827122.890411:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787827122.891003:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787827122.891009:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787827122.901839:0:6461:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787827122.902052:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787827122.902059:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787827122.903139:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787827122.903148:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787827122.905689:0:6461:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787827122.905701:0:6461:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787827122.906595:0:6461:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787827122.906676:0:6461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787827122.906682:0:6461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787827122.906770:0:6461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787827122.906802:0:6461:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787827122.906806:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787827122.906808:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827122.906809:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827122.906811:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827122.906812:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827122.906813:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827122.906814:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827122.906816:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827122.906817:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827122.906818:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827122.906820:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827122.906821:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787827122.906823:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787827122.906826:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787827122.906827:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827122.906828:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827122.906829:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827122.906830:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827122.906831:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827122.906832:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827122.906833:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827122.906833:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827122.906835:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827122.906836:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827122.906837:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787827122.906859:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787827122.906873:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821248:0@lo:253: 00000100:00100000:2.0:1787827122.906969:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827122.907014:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821248 00000100:00100000:1.0:1787827122.907021:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821248 00000100:00100000:2.0:1787827122.907032:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056335eec going to sleep for 11 seconds 00000100:00100000:1.0:1787827122.907076:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827122.907084:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b09b86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:6461:x1874672580821248:12345-0@lo:253: 20000000:01000000:1.0:1787827122.907127:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787827122.907129:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787827122.907555:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787827122.907597:0:6479:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787827122.907843:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827122.909332:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787827122.909469:0:6479:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787827122.909473:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787827122.909478:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787827122.909481:0:6479:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787827122.909490:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787827122.909586:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827122.909716:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787827122.909726:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787827122.909737:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787827122.909745:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787827122.909754:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787827122.909798:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787827122.909804:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787827122.909811:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787827122.909814:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787827122.909825:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787827122.909830:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787827122.909842:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787827122.909855:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787827122.909880:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787827122.909884:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787827122.909890:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827122.910000:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787827122.910010:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787827122.910024:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787827122.910036:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787827122.910059:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787827122.910068:0:6479:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787827122.910098:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787827122.910106:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787827122.910131:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787827122.910146:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787827122.910159:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787827122.910167:0:6479:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787827122.910188:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787827122.910195:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787827122.910206:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787827122.910217:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787827122.910282:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787827122.910302:0:6479:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787827122.910307:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787827122.910850:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787827122.910937:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787827122.910966:0:6479:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:1.0:1787827122.910968:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787827122.910985:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787827122.910991:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787827122.911004:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787827122.911009:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:1.0:1787827122.911022:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787827122.911028:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787827122.911040:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787827122.911052:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787827122.911077:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787827122.911079:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787827122.911082:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787827122.911110:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787827122.911112:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787827122.911346:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787827122.911462:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787827122.911483:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787827122.911519:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787827122.911529:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787827122.911530:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787827122.911742:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787827122.911814:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787827122.911825:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787827122.911832:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787827122.911838:0:6479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787827122.911840:0:6479:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787827122.911842:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787827122.911843:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787827122.911846:0:6479:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787827122.911850:0:6479:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787827122.912058:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787827122.912107:0:6479:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787827122.919578:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787827122.919614:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787827122.919639:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787827122.919659:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787827122.919679:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919696:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919704:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919711:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919716:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919739:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919745:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009de493a8 already unused, calling callback (000000005d28ebf6) 00010000:00010000:1.0:1787827122.919748:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919755:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919766:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919773:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.919778:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd600 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787827122.919796:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787827122.924754:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b09b86e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:6461:x1874672580821248:12345-0@lo:253: Request processed in 17664us (17778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827122.924769:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827122.924780:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821248:0@lo:253: 10000000:01000000:2.0:1787827122.924794:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787827122.924797:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787827122.924798:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827122.924800:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827122.924801:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787827122.924802:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827122.924802:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827122.924803:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827122.924804:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827122.924805:0:6461:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787827122.924806:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827122.924807:0:6461:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787827122.924822:0:6461:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e602e2f6 from lustre-MDT0000 10000000:01000000:2.0:1787827122.924853:0:6461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787827122.924855:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787827122.924859:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f8b988b19b8 10000000:01000000:2.0:1787827122.924863:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787827122.924870:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b988b19b8 from 1 10000000:01000000:2.0:1787827122.924873:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787827122.924903:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.924910:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.924916:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827122.924928:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821376:0@lo:101: 00000100:00100000:2.0:1787827122.924984:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827122.925022:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821376 00000100:00100000:3.0:1787827122.925028:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821376 00000100:00100000:2.0:1787827122.925029:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:3.0:1787827122.925061:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827122.925067:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e80baea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:6461:x1874672580821376:12345-0@lo:101: 00010000:00010000:3.0:1787827122.925077:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827122.925087:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd607 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925102:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925108:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 6 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925113:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019cf7a48, rc 0) 00000100:00100000:3.0:1787827122.925141:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e80baea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:6461:x1874672580821376:12345-0@lo:101: Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827122.925145:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787827122.925178:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821376:0@lo:101: 00010000:00010000:2.0:1787827122.925189:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925196:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827122.925257:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821504:0@lo:501: 00000100:00100000:2.0:1787827122.925278:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.925292:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:1.0:1787827122.925307:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821504 00000100:00100000:1.0:1787827122.925312:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821504 00000100:00100000:1.0:1787827122.925332:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787827122.925335:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d43ee854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:6461:x1874672580821504:12345-0@lo:501: 00000100:00100000:1.0:1787827122.925422:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d43ee854 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:6461:x1874672580821504:12345-0@lo:501: Request processed in 86us (143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827122.925434:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787827122.925450:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821504:0@lo:501: 10000000:01000000:2.0:1787827122.925474:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787827122.925491:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925499:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827122.925507:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8b98781000 10000000:01000000:2.0:1787827122.925511:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787827122.925514:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8b98781000 10000000:01000000:2.0:1787827122.925523:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787827122.925525:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f8b98781000 from 1 10000000:01000000:2.0:1787827122.925527:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787827122.925541:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925559:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925566:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827122.925577:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821632:0@lo:101: 00000100:00100000:2.0:1787827122.925596:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.925614:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:3.0:1787827122.925623:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821632 00000100:00100000:3.0:1787827122.925628:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821632 00000100:00100000:3.0:1787827122.925655:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787827122.925659:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3932def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:6461:x1874672580821632:12345-0@lo:101: 00010000:00010000:3.0:1787827122.925665:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827122.925670:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b89f97c9/0xb2e8bd65d71dd61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd615 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925680:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b89f97c9/0xb2e8bd65d71dd61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd615 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925685:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b89f97c9/0xb2e8bd65d71dd61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd615 expref: 7 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827122.925689:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b89f97c9, rc 0) 00000100:00100000:3.0:1787827122.925715:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3932def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+7:6461:x1874672580821632:12345-0@lo:101: Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827122.925721:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787827122.925758:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821632:0@lo:101: 00010000:00010000:2.0:1787827122.925772:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd61c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925780:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd61c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827122.925789:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787827122.925804:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd61c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925810:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000007d624519/0xb2e8bd65d71dd615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd61c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827122.925816:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787827122.925819:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787827122.925823:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8b98781000 10000000:01000000:2.0:1787827122.925825:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787827122.925827:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787827122.925834:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787827122.925855:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925860:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.925866:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827122.925874:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821760:0@lo:101: 00000100:00100000:2.0:1787827122.925891:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.925906:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:1.0:1787827122.925930:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821760 00000100:00100000:1.0:1787827122.925936:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821760 00000100:00100000:1.0:1787827122.925977:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787827122.925983:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094b8cb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+7:6461:x1874672580821760:12345-0@lo:101: 00010000:00010000:1.0:1787827122.925990:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827122.925997:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd623 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.926011:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.926019:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827122.926026:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009de493a8, rc 0) 00000100:00100000:1.0:1787827122.926060:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094b8cb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+8:6461:x1874672580821760:12345-0@lo:101: Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827122.926066:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787827122.926346:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821760:0@lo:101: 00010000:00010000:2.0:1787827122.926356:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827122.926365:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827122.926433:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821888:0@lo:501: 00000100:00100000:2.0:1787827122.926460:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.926498:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:0.0:1787827122.926516:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580821888 00000100:00100000:0.0:1787827122.926522:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580821888 00000100:00100000:0.0:1787827122.926557:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827122.926564:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c113cdcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+8:6461:x1874672580821888:12345-0@lo:501: 00000100:00100000:0.0:1787827122.926664:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c113cdcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6461:x1874672580821888:12345-0@lo:501: Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827122.926683:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787827122.926693:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580821888:0@lo:501: 00000100:00100000:2.0:1787827122.926723:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822016:0@lo:503: 00000100:00100000:2.0:1787827122.926758:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.926779:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cd83d5c going to sleep for 11 seconds 00000100:00100000:1.0:1787827122.926838:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822016 00000100:00100000:1.0:1787827122.926844:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822016 00000100:00100000:1.0:1787827122.926872:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787827122.926878:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005923bd13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6461:x1874672580822016:12345-0@lo:503: 00000100:00100000:1.0:1787827122.926974:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005923bd13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6461:x1874672580822016:12345-0@lo:503: Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827122.926981:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787827122.927001:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822016:0@lo:503: 00000100:00100000:2.0:1787827122.927279:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6506:1874672580822144:0@lo:502: 00000100:00100000:2.0:1787827122.927311:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827122.927328:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082464219 going to sleep for 11 seconds 00000100:00100000:0.0:1787827122.927352:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822144 00000100:00100000:0.0:1787827122.927357:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822144 00000100:00100000:0.0:1787827122.927404:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787827122.927410:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f95a3bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6506:x1874672580822144:12345-0@lo:502: 00000100:00100000:0.0:1787827122.927502:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f95a3bfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6506:x1874672580822144:12345-0@lo:502: Request processed in 92us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827122.927513:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6506:1874672580822144:0@lo:502: 00000020:01000000:2.0:1787827122.927529:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827122.927537:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827122.927538:0:6506:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787827122.927542:0:6506:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787827122.927544:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787827122.927569:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000205732cf) 00000020:00000080:2.0:1787827122.927597:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787827122.927604:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1787827122.927637:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00080000:01000000:2.0:1787827122.927696:0:6506:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787827122.927702:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd638 00000020:00000080:2.0:1787827122.927863:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787827122.927866:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827122.927868:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827122.927869:0:6506:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787827122.927871:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827122.927873:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827122.927874:0:6506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787827122.927875:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787827122.927880:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046018a2a) 00000020:00000080:2.0:1787827122.927886:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787827122.927888:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787827122.927889:0:6506:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787827122.927890:0:6506:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787827122.927894:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787827122.927925:0:6506:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e602e2f6 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787827122.927933:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ef3ad228) 00000020:00000080:2.0:1787827122.927938:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787827122.928002:0:6506:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787827122.928007:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71dd64d 00000020:00000080:2.0:1787827122.928098:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787827122.928103:0:6506:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787827122.928107:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb2e8bd65d71dd654 00080000:01000000:2.0:1787827122.928112:0:6506:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787827122.928115:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd65b 00080000:10000000:2.0:1787827122.928688:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787827122.928810:0:6506:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787827122.932319:0:6506:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787827122.984486:0:6506:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787827122.984742:0:6506:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787827122.987004:0:6506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787827122.987214:0:6506:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787827122.989010:0:6506:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000084b6ffbd) 00000020:00000080:2.0:1787827122.989028:0:6506:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787827122.989117:0:6506:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787827122.989124:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd669 00000020:00000080:3.0:1787827122.989975:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787827122.990820:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1787827122.994994:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1787827122.996360:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1787827122.998126:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1787827123.000136:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1787827123.001419:0:6506:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1787827123.002537:0:6506:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb2e8bd65d71dd670 00000020:00000080:2.0:1787827123.002805:0:6506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787827123.002817:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827123.002824:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827123.002826:0:6506:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787827123.002829:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827123.002833:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827123.002835:0:6506:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787827123.002838:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787827123.002839:0:6506:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787827123.002842:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827123.002844:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827123.002846:0:6506:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787827123.002848:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827123.002851:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827123.002852:0:6506:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787827123.002862:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787827123.002904:0:6506:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787827123.002966:0:6506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6506:1874672580822272:0@lo:502: 00000100:00100000:2.0:1787827123.003037:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827123.003083:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822272 00000100:00100000:1.0:1787827123.003091:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822272 00000100:00100000:2.0:1787827123.003101:0:6506:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082464219 going to sleep for 11 seconds 00000100:00100000:1.0:1787827123.003143:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787827123.003151:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccebf231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6506:x1874672580822272:12345-0@lo:502: 00000100:00100000:1.0:1787827123.003255:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccebf231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6506:x1874672580822272:12345-0@lo:502: Request processed in 105us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827123.003265:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787827123.003290:0:6506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6506:1874672580822272:0@lo:502: 00000020:01000000:2.0:1787827123.003312:0:6506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827123.003315:0:6506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827123.003316:0:6506:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787827123.003318:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787827123.003410:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787827123.003429:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787827123.003440:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.003455:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827123.003463:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8b98781000 from 1 10000000:01000000:3.0:1787827123.003466:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787827123.003491:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.003499:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.003507:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.003519:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822400:0@lo:101: 00000100:00100000:3.0:1787827123.003552:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.003633:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2e75d7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.003675:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822400 00000100:00100000:0.0:1787827123.003679:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822400 00000100:00100000:0.0:1787827123.003727:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787827123.003745:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0086df7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:6461:x1874672580822400:12345-0@lo:101: 00010000:00010000:0.0:1787827123.003754:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827123.003767:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd677 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.003793:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.003802:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.003810:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046fe5129, rc 0) 00000100:00100000:0.0:1787827123.003845:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0086df7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6461:x1874672580822400:12345-0@lo:101: Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.003851:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787827123.003922:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822400:0@lo:101: 00010000:00010000:3.0:1787827123.003934:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.003951:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.004502:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822528:0@lo:256: 00000100:00100000:3.0:1787827123.004534:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.004600:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2e75d7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.004643:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822528 00000100:00100000:0.0:1787827123.004648:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822528 00000100:00100000:0.0:1787827123.004673:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787827123.004679:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007e51181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6461:x1874672580822528:12345-0@lo:256: 20000000:01000000:0.0:1787827123.004691:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787827123.004697:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787827123.004856:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007e51181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6461:x1874672580822528:12345-0@lo:256: Request processed in 177us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.004864:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787827123.004916:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822528:0@lo:256: 10000000:01000000:3.0:1787827123.005514:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787827123.005529:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.005539:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827123.005546:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8b98781000 from 1 10000000:01000000:3.0:1787827123.005549:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787827123.005570:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.005575:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.005583:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.005595:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822656:0@lo:101: 00000100:00100000:3.0:1787827123.005622:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.005649:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2e75d7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.005695:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822656 00000100:00100000:0.0:1787827123.005699:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822656 00000100:00100000:0.0:1787827123.005721:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787827123.005727:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c37b586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6461:x1874672580822656:12345-0@lo:101: 00010000:00010000:0.0:1787827123.005734:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827123.005751:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd685 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.005767:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.005775:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.005782:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a924e5cc, rc 0) 00000100:00100000:0.0:1787827123.005856:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c37b586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580822656:12345-0@lo:101: Request processed in 129us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.005860:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787827123.005904:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822656:0@lo:101: 00010000:00010000:3.0:1787827123.005912:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.005917:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.005969:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822784:0@lo:501: 00000100:00100000:3.0:1787827123.005987:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.006004:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2e75d7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.006032:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822784 00000100:00100000:0.0:1787827123.006037:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822784 00000100:00100000:0.0:1787827123.006065:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787827123.006070:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd506ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580822784:12345-0@lo:501: 00000100:00100000:0.0:1787827123.006199:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd506ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580822784:12345-0@lo:501: Request processed in 128us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.006206:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787827123.006237:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822784:0@lo:501: 00000100:00100000:3.0:1787827123.006268:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822912:0@lo:503: 00000100:00100000:3.0:1787827123.006306:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.006326:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2e75d7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.006338:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580822912 00000100:00100000:0.0:1787827123.006343:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580822912 00000100:00100000:0.0:1787827123.006368:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787827123.006373:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa3aefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580822912:12345-0@lo:503: 00000040:00080000:0.0:1787827123.006422:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787827123.006459:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa3aefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580822912:12345-0@lo:503: Request processed in 86us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.006475:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787827123.006482:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a29dc9f pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580822912:0@lo:503: 00000040:00080000:3.0:1787827123.007343:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787827123.007428:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787827123.007449:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787827123.007465:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.007474:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827123.007512:0:6461:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787827123.007514:0:6461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8b98781000 10000000:01000000:2.0:1787827123.007517:0:6461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8b98781000 10000000:01000000:2.0:1787827123.007519:0:6461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787827123.007522:0:6461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8b98781000 from 1 10000000:01000000:2.0:1787827123.007523:0:6461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787827123.007541:0:6461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.007548:0:6461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.007566:0:6461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827123.007578:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823040:0@lo:101: 00000100:00100000:2.0:1787827123.007614:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827123.007641:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082464219 going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.007655:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823040 00000100:00100000:0.0:1787827123.007665:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823040 00000100:00100000:0.0:1787827123.007695:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787827123.007700:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce0e6a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6461:x1874672580823040:12345-0@lo:101: 00010000:00010000:0.0:1787827123.007706:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827123.007713:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd693 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.007726:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.007732:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.007738:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9d517f5, rc 0) 00000100:00100000:0.0:1787827123.007772:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce0e6a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823040:12345-0@lo:101: Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.007778:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787827123.007805:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823040:0@lo:101: 00010000:00010000:2.0:1787827123.007818:0:6461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.007826:0:6461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827123.007872:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823168:0@lo:501: 00000100:00100000:2.0:1787827123.007898:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827123.007914:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082464219 going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.007920:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823168 00000100:00100000:0.0:1787827123.007924:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823168 00000100:00100000:0.0:1787827123.007962:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827123.007968:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015877477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823168:12345-0@lo:501: 00000100:00100000:0.0:1787827123.008039:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015877477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823168:12345-0@lo:501: Request processed in 73us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.008044:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787827123.008074:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823168:0@lo:501: 00000100:00100000:2.0:1787827123.008100:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823296:0@lo:503: 00000100:00100000:2.0:1787827123.008133:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827123.008152:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823296 00000100:00100000:0.0:1787827123.008156:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823296 00000100:00100000:2.0:1787827123.008157:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082464219 going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.008177:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787827123.008181:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000651ab360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823296:12345-0@lo:503: 00000100:00100000:0.0:1787827123.008235:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000651ab360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823296:12345-0@lo:503: Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.008244:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787827123.008264:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823296:0@lo:503: 00000100:00100000:2.0:1787827123.008525:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6511:1874672580823424:0@lo:502: 00000100:00100000:2.0:1787827123.008556:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827123.008578:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069224b7c going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.008586:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823424 00000100:00100000:0.0:1787827123.008590:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823424 00000100:00100000:0.0:1787827123.008614:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787827123.008619:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006faca0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6511:x1874672580823424:12345-0@lo:502: 00000100:00100000:0.0:1787827123.008678:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006faca0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6511:x1874672580823424:12345-0@lo:502: Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.008684:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787827123.008688:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6511:1874672580823424:0@lo:502: 00000020:01000004:2.0:1787827123.008743:0:6511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787827123.008762:0:6511:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000018ff8f5a) 00000020:00000080:2.0:1787827123.008778:0:6511:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787827123.008857:0:6511:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e602e2f6 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787827123.008861:0:6511:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e602e2f6 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787827123.008863:0:6511:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e602e2f6 4 00010000:00080000:2.0:1787827123.008886:0:6511:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c3187e90@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787827123.012812:0:6511:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787827123.013012:0:6511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787827123.013051:0:6511:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787827123.013063:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb2e8bd65d71dd6a8 00000100:00080000:2.0:1787827123.013072:0:6511:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787827123.013077:0:6511:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c3187e90 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787827123.013107:0:6511:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003f09302e x1874672580823552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787827123.013125:0:6511:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787827123.013162:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1874672580823552:0@lo:38: 00000100:00100000:3.0:1787827123.013234:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827123.013283:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823552 00000100:00100000:2.0:1787827123.013291:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823552 00000100:00100000:2.0:1787827123.013325:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827123.013332:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a29dc9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1874672580823552:12345-0@lo:38: 00000100:00100000:2.0:1787827123.013419:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a29dc9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1874672580823552:12345-0@lo:38: Request processed in 87us (186us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787827123.013426:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827123.013428:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4bc0127 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6511:1874672580823680:0@lo:502: 00000100:00100000:2.0:1787827123.013463:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787827123.013469:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000c3187e90 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787827123.013475:0:3612:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787827123.013478:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1874672580823552:0@lo:38: 00000100:00100000:3.0:1787827123.013481:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.013514:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 00000000973f4c2d going to sleep for 11 seconds 00000100:00100000:1.0:1787827123.013569:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823680 00000100:00100000:1.0:1787827123.013574:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823680 00000100:00100000:1.0:1787827123.013627:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787827123.013636:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a5627e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6511:x1874672580823680:12345-0@lo:502: 00000100:00100000:1.0:1787827123.013764:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a5627e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6511:x1874672580823680:12345-0@lo:502: Request processed in 131us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827123.013771:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787827123.013987:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4bc0127 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:6511:1874672580823680:0@lo:502: 00000040:00080000:3.0:1787827123.014012:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787827123.014097:0:6461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787827123.014121:0:6461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827123.014136:0:6461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827123.014146:0:6461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787827123.014191:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787827123.014193:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827123.014194:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827123.014196:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827123.014197:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827123.014198:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827123.014199:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827123.014201:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827123.014202:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827123.014204:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827123.014205:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827123.014206:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827123.014210:0:6461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787827123.014213:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787827123.014214:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827123.014215:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827123.014217:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827123.014217:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827123.014218:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827123.014219:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827123.014220:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827123.014221:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827123.014222:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827123.014223:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827123.014224:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827123.014237:0:6461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787827123.014246:0:6461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823808:0@lo:253: 00000100:00100000:2.0:1787827123.014278:0:6461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827123.014309:0:6461:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b7422c3 going to sleep for 11 seconds 00000100:00100000:3.0:1787827123.014324:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823808 00000100:00100000:3.0:1787827123.014330:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823808 00000100:00100000:3.0:1787827123.014360:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787827123.014440:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000563d2a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823808:12345-0@lo:253: 20000000:01000000:3.0:1787827123.014461:0:6476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787827123.014474:0:6476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787827123.018003:0:6476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787827123.018017:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787827123.018039:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787827123.018044:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787827123.018062:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.018078:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.018086:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.018118:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.018138:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827123.018151:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091c7076c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580823936:0@lo:104: 00000100:00100000:1.0:1787827123.018221:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.018243:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000563d2a72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6461:x1874672580823808:12345-0@lo:253: Request processed in 3873us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827123.018255:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787827123.018266:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set 000000005fd8d34a going to sleep for 11 seconds 00000100:00100000:0.0:1787827123.018270:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580823936 00000100:00100000:0.0:1787827123.018278:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580823936 00000100:00100000:2.0:1787827123.018285:0:6461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:6461:1874672580823808:0@lo:253: 10000000:01000000:2.0:1787827123.018300:0:6461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787827123.018303:0:6461:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787827123.018305:0:6461:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787827123.018306:0:6461:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827123.018307:0:6461:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827123.018309:0:6461:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827123.018310:0:6461:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827123.018311:0:6461:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827123.018312:0:6461:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787827123.018314:0:6461:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827123.018315:0:6461:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827123.018317:0:6461:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827123.018319:0:6461:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1787827123.018328:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:02000000:2.0:1787827123.018334:0:6461:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787827123.018337:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c18078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580823936:12345-0@lo:104: 00010000:00010000:0.0:1787827123.018349:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827123.018433:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827123.018441:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c18078 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580823936:12345-0@lo:104: Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827123.018446:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787827123.018470:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091c7076c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580823936:0@lo:104: 00010000:00010000:1.0:1787827123.018480:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018500:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827123.018506:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018514:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de8256bf already unused, calling callback (00000000f4bdffda) 10000000:00010000:3.0:1787827123.018516:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018524:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827123.018530:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827123.018536:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787827123.018574:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018580:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787827123.018606:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018613:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000de8256bf/0xb2e8bd65d71dd677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd67e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018626:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827123.018628:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827123.018630:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827123.018635:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4bc0127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580824064:0@lo:103: 00000100:00100000:0.0:1787827123.018682:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827123.018728:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824064 00000100:00100000:3.0:1787827123.018733:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824064 00010000:00010000:3.0:1787827123.018750:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.018782:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827123.018788:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ddf8508 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3614:x1874672580824064:12345-0@lo:103: 00010000:00010000:3.0:1787827123.018798:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827123.018802:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018812:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018824:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000046fe5129/0xb2e8bd65d71dd67e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd677 expref: 12 pid: 6476 timeout: 225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018835:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018842:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787827123.018854:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000810368s 00010000:00010000:3.0:1787827123.018857:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018863:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018869:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018884:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018888:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010589ae5 already unused, calling callback (000000005d28ebf6) 00010000:00010000:3.0:1787827123.018891:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018898:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018912:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827123.018921:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827123.018955:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827123.018965:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.018965:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ddf8508 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:3614:x1874672580824064:12345-0@lo:103: Request processed in 176us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827123.018981:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010589ae5/0xb2e8bd65d71dd6af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827123.018982:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787827123.019221:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4bc0127 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580824064:0@lo:103: 00080000:10000000:2.0:1787827123.022130:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1787827123.022290:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787827123.022526:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787827123.022649:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787827123.022812:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787827123.022961:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1787827123.023533:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787827123.023696:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787827123.023871:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787827123.024055:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787827123.024291:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787827123.024611:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1787827123.026572:0:6461:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:2.0:1787827123.031911:0:6516:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000040:01000000:3.0:1787827123.031914:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787827123.031916:0:6516:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787827123.032138:0:6517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787827123.033200:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787827123.033353:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787827123.033819:0:6461:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787827123.033827:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787827123.034433:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827123.035453:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787827123.035613:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827123.035979:0:6461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787827123.036008:0:6461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787827123.036204:0:6461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787827123.036423:0:6461:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1787827123.037098:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787827123.037240:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787827123.037433:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787827123.037566:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787827123.037702:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787827123.037843:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787827123.038011:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787827123.038149:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787827123.038283:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787827123.038437:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000040:00080000:3.0:1787827123.038550:0:6517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:2.0:1787827123.038581:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000004:00080000:3.0:1787827123.038610:0:6517:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787827123.038614:0:6517:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1787827123.038709:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787827123.038841:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787827123.038985:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787827123.039178:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787827123.039309:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787827123.039598:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787827123.039737:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787827123.039872:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787827123.040003:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787827123.040130:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787827123.040276:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787827123.040437:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787827123.040522:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787827123.040609:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787827123.040704:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787827123.040813:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787827123.040913:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787827123.041023:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787827123.041122:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787827123.041235:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787827123.041350:0:6461:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787827123.041504:0:6461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1787827123.043427:0:6461:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787827123.043449:0:6461:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e9b41c97988 00100000:10000000:2.0:1787827123.043455:0:6461:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787827123.043918:0:6461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787827123.043929:0:6461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787827123.043954:0:6461:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787827123.043965:0:6461:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787827123.044863:0:6461:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827123.045051:0:6461:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1787827123.862561:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787827124.526348:0:6761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787827124.886481:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827124.892596:0:6813:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827124.892763:0:6813:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787827125.910597:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827126.544721:0:6914:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827126.544861:0:6914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787827126.935468:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827127.959835:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787827128.214611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787827128.214618:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787827128.214622:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c3187e90 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787827128.214634:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c3187e90 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787827128.214665:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d6d948e x1874672580824320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827128.214721:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e66b43c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580824192:0@lo:400: 00000100:00100000:2.0:1787827128.214723:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d6d948e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1874672580824320:0@lo:38: 00000100:00100000:3.0:1787827128.214798:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827128.214799:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827128.214846:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824192 00000100:00100000:1.0:1787827128.214853:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824192 00000100:00100000:0.0:1787827128.214893:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824320 00000100:00100000:1.0:1787827128.214895:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787827128.214899:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824320 00000100:00100000:1.0:1787827128.214914:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001464cd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:3615:x1874672580824192:12345-0@lo:400: 00000100:00100000:0.0:1787827128.214946:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787827128.214952:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000197b30e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1874672580824320:12345-0@lo:38: 00010000:00080000:0.0:1787827128.214975:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 80 last 0 00000100:00100000:1.0:1787827128.214981:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001464cd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:3615:x1874672580824192:12345-0@lo:400: Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827128.214991:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787827128.214992:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e66b43c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580824192:0@lo:400: 00000020:00000080:0.0:1787827128.215016:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb2e8bd65d71dd6b6 00000004:00100000:0.0:1787827128.215053:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787827128.215156:0:6486:0:(import.c:65:import_set_state_nolock()) 00000000e3dff3f7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827128.215214:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000197b30e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1874672580824320:12345-0@lo:38: Request processed in 262us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827128.215222:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787827128.215246:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d6d948e x1874672580824320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787827128.215260:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787827128.215274:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787827128.215283:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787827128.215286:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000c3187e90 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827128.215292:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d6d948e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1874672580824320:0@lo:38: 00010000:00010000:3.0:1787827128.982534:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787827129.830672:0:7412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787827129.830676:0:7412:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787827129.830678:0:7412:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787827129.830842:0:7412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d0ad83bd 00000020:01000004:0.0:1787827129.830855:0:7412:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1787827129.830865:0:7412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787827129.830878:0:7412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d793d57b) 00000020:00000080:0.0:1787827129.830907:0:7412:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787827129.851415:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787827129.851474:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1787827129.862925:0:7412:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787827129.863143:0:7412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787827129.863152:0:7412:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787827129.863162:0:7412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dd6c4 00000020:01000004:1.0:1787827129.863173:0:7412:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787827129.863192:0:7412:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787827129.863194:0:7412:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787827129.863200:0:7412:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787827129.863225:0:7412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787827129.863229:0:7412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787827129.873759:0:7412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787827129.873795:0:7412:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1787827129.873799:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787827129.873801:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787827129.873802:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787827129.873804:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787827129.873805:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787827129.873806:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787827129.873807:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787827129.873808:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787827129.873810:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787827129.873811:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787827129.873813:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787827129.873815:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1787827129.873818:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787827129.873819:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787827129.873820:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787827129.873821:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787827129.873821:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787827129.873823:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787827129.873823:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787827129.873824:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787827129.873824:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787827129.873825:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787827129.873826:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787827129.873848:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787827129.873859:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580824448:0@lo:253: 00000100:00100000:1.0:1787827129.873925:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.873974:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000044c7e03a going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.874016:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824448 00000100:00100000:3.0:1787827129.874028:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824448 00000100:00100000:3.0:1787827129.874076:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787827129.874084:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ad98a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:7412:x1874672580824448:12345-0@lo:253: 20000000:01000000:3.0:1787827129.874106:0:6476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787827129.874110:0:6476:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1787827129.874113:0:6476:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1787827129.874116:0:6476:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1787827129.874141:0:6476:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1787827129.874289:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827129.874431:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787827129.874454:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787827129.874470:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787827129.874491:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787827129.874502:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787827129.874549:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1787827129.874564:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787827129.874588:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787827129.874594:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787827129.874605:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787827129.874609:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787827129.874620:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787827129.874640:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787827129.874734:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787827129.874743:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1787827129.874767:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787827129.874773:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787827129.874785:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787827129.874789:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1787827129.874799:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787827129.874803:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787827129.874813:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787827129.874825:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787827129.874833:0:6476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787827129.874911:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787827129.874920:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787827129.874988:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787827129.875008:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787827129.875022:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787827129.875027:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787827129.875038:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787827129.875054:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787827129.875059:0:6476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787827129.875078:0:6476:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787827129.875084:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787827129.875421:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787827129.875565:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787827129.875583:0:6476:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:0.0:1787827129.875585:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787827129.875599:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787827129.875605:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787827129.875616:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787827129.875621:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787827129.875643:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787827129.875656:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787827129.875670:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787827129.875683:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787827129.875741:0:6476:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787827129.875748:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787827129.876020:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787827129.876142:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787827129.876156:0:6476:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:0.0:1787827129.876158:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:0.0:1787827129.876171:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787827129.876176:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787827129.876188:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787827129.876193:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:0.0:1787827129.876203:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787827129.876208:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1787827129.876216:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787827129.876228:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1787827129.876243:0:6476:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787827129.876246:0:6476:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787827129.876250:0:6476:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787827129.876299:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787827129.876301:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787827129.876513:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787827129.876532:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787827129.876545:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787827129.876621:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787827129.876637:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787827129.876654:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787827129.876662:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787827129.876664:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787827129.876846:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787827129.876863:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787827129.876881:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787827129.876959:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787827129.876991:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787827129.877008:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787827129.877018:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787827129.877019:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787827129.877194:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787827129.877215:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787827129.877224:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787827129.877289:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787827129.877318:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787827129.877332:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787827129.877343:0:6476:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787827129.877345:0:6476:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787827129.877348:0:6476:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787827129.877353:0:6476:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787827129.877588:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787827129.877629:0:6476:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787827129.883350:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787827129.883425:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883444:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883451:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883457:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883464:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883505:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883517:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 11 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.883530:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020f9850c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824576:0@lo:104: 00000100:00100000:0.0:1787827129.883596:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.883639:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824576 00000100:00100000:3.0:1787827129.883646:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824576 00010000:00010000:0.0:1787827129.883647:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883656:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 11 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.883664:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824704:0@lo:104: 00000100:00100000:0.0:1787827129.883684:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.883693:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824704 00000100:00100000:3.0:1787827129.883697:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824704 00010000:00010000:0.0:1787827129.883701:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 11 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883710:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 11 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.883717:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787827129.883722:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824832:0@lo:104: 00000100:00100000:0.0:1787827129.883743:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.883748:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f435f39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580824576:12345-0@lo:104: 00010000:00010000:2.0:1787827129.883761:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.883762:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edf09f19 going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.883763:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787827129.883773:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787827129.883823:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787827129.883827:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f435f39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580824576:12345-0@lo:104: Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.883834:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787827129.883840:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787827129.883843:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020f9850c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824576:0@lo:104: 00010000:00010000:3.0:1787827129.883845:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.883854:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d69503b already unused, calling callback (00000000f4bdffda) 00000100:00100000:2.0:1787827129.883856:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824832 10000000:00010000:3.0:1787827129.883857:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.883862:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824832 00010000:00010000:3.0:1787827129.883865:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827129.883872:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.883875:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787827129.883887:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787827129.883908:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097855df2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580824704:12345-0@lo:104: 00010000:00010000:3.0:1787827129.883913:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.883917:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827129.883919:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787827129.883924:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8b98781000 from 21 10000000:01000000:0.0:1787827129.883931:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827129.883947:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827129.883955:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883964:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.883969:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.883972:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.883979:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787827129.883988:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eaf30b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580824960:0@lo:103: 00000100:00100000:2.0:1787827129.883989:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097855df2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580824704:12345-0@lo:104: Request processed in 94us (303us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827129.883998:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000000d69503b/0xb2e8bd65d71dd693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd69a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884008:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827129.884020:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ecba8d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825088:0@lo:101: 00010000:00010000:3.0:1787827129.884025:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827129.884029:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884030:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787827129.884038:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a200d26 already unused, calling callback (00000000f4bdffda) 10000000:00010000:3.0:1787827129.884040:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884044:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000434c6d12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580824832:12345-0@lo:104: 00000100:00100000:1.0:1787827129.884048:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827129.884056:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.884059:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884061:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787827129.884070:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.884077:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827129.884085:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00010000:00010000:3.0:1787827129.884094:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884101:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827129.884110:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787827129.884114:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580824960 00000100:00100000:2.0:1787827129.884118:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000434c6d12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580824832:12345-0@lo:104: Request processed in 77us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.884120:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580824960 00010000:00010000:3.0:1787827129.884121:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884131:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787827129.884133:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000001a200d26/0xb2e8bd65d71dd623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd62a expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884135:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000070b51c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580825216:0@lo:103: 00010000:00010000:1.0:1787827129.884140:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884169:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787827129.884170:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827129.884174:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884179:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009164ab01 already unused, calling callback (00000000f4bdffda) 00000100:00100000:1.0:1787827129.884181:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825216 00000100:00100000:2.0:1787827129.884181:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824704:0@lo:104: 10000000:00010000:3.0:1787827129.884182:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884186:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825216 00010000:00010000:3.0:1787827129.884195:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827129.884199:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.884202:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 13 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.884204:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787827129.884205:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580824832:0@lo:104: 00000100:00100000:0.0:1787827129.884212:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787827129.884221:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884227:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f1293a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:3616:x1874672580824960:12345-0@lo:103: 00000100:00100000:1.0:1787827129.884231:0:6470:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1787827129.884231:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827129.884239:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884240:0:6470:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787827129.884241:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827129.884242:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884251:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 13 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884259:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825088 00010000:00010000:3.0:1787827129.884263:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000009164ab01/0xb2e8bd65d71dd607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd60e expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884264:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825088 00010000:00010000:0.0:1787827129.884270:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 14 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884281:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827129.884284:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827129.884285:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827129.884286:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9d517f5/0xb2e8bd65d71dd69a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd693 expref: 14 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884294:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787827129.884300:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827129.884301:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827129.884303:0:6479:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1787827129.884305:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b799b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580825088:12345-0@lo:101: 00000100:00100000:2.0:1787827129.884312:0:6479:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00010000:00010000:1.0:1787827129.884316:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787827129.884318:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031a67975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580825344:0@lo:103: 00010000:00010000:1.0:1787827129.884327:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd6d2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884337:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f1293a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3616:x1874672580824960:12345-0@lo:103: Request processed in 115us (294us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827129.884343:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884346:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787827129.884356:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.884366:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.884369:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787827129.884369:0:6478:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884406:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b9833ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:3613:x1874672580825216:12345-0@lo:103: 00010000:00010000:0.0:1787827129.884416:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827129.884418:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884421:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 13 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.884435:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1da4e67, rc 0) 00010000:00010000:0.0:1787827129.884444:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 13 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.884448:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787827129.884456:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825344 00010000:00010000:0.0:1787827129.884458:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009de493a8/0xb2e8bd65d71dd62a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd623 expref: 13 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.884460:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825344 00010000:00010000:0.0:1787827129.884473:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827129.884474:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 13 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884487:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b799b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580825088:12345-0@lo:101: Request processed in 185us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.884491:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787827129.884496:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787827129.884504:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787827129.884514:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a473d16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3614:x1874672580825344:12345-0@lo:103: 00000100:00100000:0.0:1787827129.884518:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b9833ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3613:x1874672580825216:12345-0@lo:103: Request processed in 137us (349us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827129.884525:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787827129.884530:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787827129.884533:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 12 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884540:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eaf30b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580824960:0@lo:103: 00010000:00010000:3.0:1787827129.884548:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 11 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884560:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019cf7a48/0xb2e8bd65d71dd60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd607 expref: 11 pid: 6478 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884570:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884577:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.884580:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ecba8d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825088:0@lo:101: 00010000:00010000:3.0:1787827129.884589:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.884593:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884595:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.884610:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884627:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000070b51c43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580825216:0@lo:103: 00010000:00010000:3.0:1787827129.884627:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884638:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884641:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041cdc336 already unused, calling callback (000000005d28ebf6) 00010000:00010000:3.0:1787827129.884644:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884648:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884661:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884666:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884681:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 00000000c1da4e67/0xb2e8bd65d71dd6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.884689:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6469:1874672580825472:0@lo:105: 00000100:00100000:3.0:1787827129.884719:0:6469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.884740:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024741f7a going to sleep for 11 seconds 00000100:00100000:0.0:1787827129.884745:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825472 00000100:00100000:0.0:1787827129.884750:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825472 00010000:00010000:2.0:1787827129.884751:0:6476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.884760:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787827129.884771:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787827129.884781:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787827129.884790:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf19da25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6469:x1874672580825472:12345-0@lo:105: 00010000:00010000:0.0:1787827129.884797:0:6468:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884803:0:6468:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884810:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884816:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884822:0:6468:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.884854:0:6468:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 0000000091eb5131) 00010000:00010000:2.0:1787827129.884875:0:6481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.884883:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.884909:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf19da25 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6469:x1874672580825472:12345-0@lo:105: Request processed in 120us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.884917:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787827129.884931:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6469:1874672580825472:0@lo:105: 00010000:00010000:3.0:1787827129.884946:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.884954:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041cdc336/0xb2e8bd65d71dd6cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.884966:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000206ec1e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825600:0@lo:501: 00010000:00010000:3.0:1787827129.884974:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827129.885004:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.885026:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a473d16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:3614:x1874672580825344:12345-0@lo:103: Request processed in 513us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.885029:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 00000000554811bc going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.885036:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787827129.885040:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031a67975 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580825344:0@lo:103: 00000100:00100000:2.0:1787827129.885054:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825600 00000100:00100000:2.0:1787827129.885059:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825600 00000100:00100000:2.0:1787827129.885088:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787827129.885096:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deadae39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6481:x1874672580825600:12345-0@lo:501: 00000100:00100000:2.0:1787827129.885199:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deadae39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6481:x1874672580825600:12345-0@lo:501: Request processed in 105us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.885207:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787827129.885227:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000206ec1e5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825600:0@lo:501: 00000100:00100000:1.0:1787827129.885254:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdea1816 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825728:0@lo:503: 00000100:00100000:1.0:1787827129.885287:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.885302:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f8b4312 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.885319:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825728 00000100:00100000:2.0:1787827129.885324:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825728 00000100:00100000:2.0:1787827129.885348:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787827129.885355:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008bb5106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6481:x1874672580825728:12345-0@lo:503: 00000100:00100000:2.0:1787827129.885455:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008bb5106 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6481:x1874672580825728:12345-0@lo:503: Request processed in 100us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.885461:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787827129.885981:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdea1816 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580825728:0@lo:503: 00000100:00100000:1.0:1787827129.886238:0:7427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7427:1874672580825856:0@lo:502: 00000100:00100000:1.0:1787827129.886272:0:7427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.886305:0:7427:0:(client.c:2715:ptlrpc_set_wait()) set 000000001540a5bb going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.886309:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ad98a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:7412:x1874672580824448:12345-0@lo:253: Request processed in 12225us (12382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.886316:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787827129.886317:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825856 00000100:00100000:3.0:1787827129.886323:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825856 00000100:00100000:0.0:1787827129.886343:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580824448:0@lo:253: 00000100:00100000:2.0:1787827129.886348:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 10000000:01000000:0.0:1787827129.886359:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787827129.886364:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:2.0:1787827129.886365:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054014785 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:7427:x1874672580825856:12345-0@lo:502: 00000020:01000004:0.0:1787827129.886367:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787827129.886371:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827129.886373:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1787827129.886375:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827129.886399:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827129.886401:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787827129.886403:0:7412:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787827129.886405:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827129.886406:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787827129.886425:0:7412:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d0ad83bd from lustre-MDT0001 10000000:01000000:0.0:1787827129.886443:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787827129.886446:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787827129.886452:0:7412:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b988b19b8 local copy 10000000:01000000:0.0:1787827129.886456:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787827129.886475:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.886484:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.886492:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.886519:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c94c03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580825984:0@lo:101: 00000100:00100000:2.0:1787827129.886522:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054014785 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:7427:x1874672580825856:12345-0@lo:502: Request processed in 158us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.886530:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787827129.886532:0:7427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7427:1874672580825856:0@lo:502: 00000100:00100000:0.0:1787827129.886560:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.886580:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580825984 00000100:00100000:2.0:1787827129.886585:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580825984 00000100:00100000:0.0:1787827129.886587:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00000100:00100000:1.0:1787827129.886602:0:7427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7427:1874672580826112:0@lo:502: 00000100:00100000:2.0:1787827129.886622:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787827129.886629:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4f19830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+9:7412:x1874672580825984:12345-0@lo:101: 00010000:00010000:2.0:1787827129.886641:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827129.886656:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd6e0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.886657:0:7427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827129.886675:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6e0 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.886677:0:7427:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e1299b4 going to sleep for 11 seconds 00000100:00100000:0.0:1787827129.886682:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826112 00000100:00100000:0.0:1787827129.886689:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826112 00010000:00010000:2.0:1787827129.886696:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6e0 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.886703:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071a1a6ac, rc 0) 00000100:00100000:0.0:1787827129.886723:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787827129.886731:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c5500bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:7427:x1874672580826112:12345-0@lo:502: 00000100:00100000:2.0:1787827129.886743:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4f19830 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:7412:x1874672580825984:12345-0@lo:101: Request processed in 114us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.886750:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787827129.886771:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c94c03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580825984:0@lo:101: 00010000:00010000:3.0:1787827129.886784:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.886793:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.886799:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c5500bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:7427:x1874672580826112:12345-0@lo:502: Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.886807:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787827129.886815:0:7427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7427:1874672580826112:0@lo:502: 00000040:00080000:1.0:1787827129.886838:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000100:00100000:3.0:1787827129.886878:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826240:0@lo:501: 00000020:01000000:2.0:1787827129.886919:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 00000100:00100000:3.0:1787827129.886927:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1787827129.886948:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1787827129.886950:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000936b9c81 going to sleep for 11 seconds 00010000:00010000:2.0:1787827129.886955:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.886959:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826240 00000100:00100000:0.0:1787827129.886964:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826240 00010000:00010000:2.0:1787827129.886969:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000091eb5131/0xb2e8bd65d71dd6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827129.886979:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827129.886981:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8b98781000 from 3 10000000:01000000:2.0:1787827129.886983:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:0.0:1787827129.886987:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787827129.886995:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b654644b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:7412:x1874672580826240:12345-0@lo:501: 00010000:00010000:2.0:1787827129.887002:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.887020:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.887027:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.887040:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2f8f487 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580826368:0@lo:101: 00000100:00100000:0.0:1787827129.887042:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b654644b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:7412:x1874672580826240:12345-0@lo:501: Request processed in 49us (122us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787827129.887050:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826240:0@lo:501: 00000100:00100000:0.0:1787827129.887052:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 10000000:01000000:3.0:1787827129.887070:0:7412:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787827129.887093:0:7412:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787827129.887096:0:7412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887101:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.887106:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827129.887117:0:7412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.887127:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826368 00000100:00100000:2.0:1787827129.887128:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000005361199a going to sleep for 11 seconds 00000100:00100000:0.0:1787827129.887131:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826368 00010000:00010000:3.0:1787827129.887132:0:7412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787827129.887151:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8bba965800 00010000:00010000:1.0:1787827129.887154:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787827129.887155:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000100:00100000:0.0:1787827129.887158:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787827129.887162:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.887163:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f8b988b19b8 00000100:00100000:0.0:1787827129.887168:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a73c81d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+10:6481:x1874672580826368:12345-0@lo:101: 10000000:01000000:3.0:1787827129.887168:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787827129.887174:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f8b988b19b8 from 1 00010000:00010000:0.0:1787827129.887179:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:01000000:3.0:1787827129.887179:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787827129.887180:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046fe5129 already unused, calling callback (00000000f4bdffda) 10000000:00010000:1.0:1787827129.887185:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887189:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd6ee expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.887194:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887196:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887203:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 11 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887213:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827129.887214:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887220:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 11 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887231:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827129.887234:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787827129.887236:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b77b65a7, rc 0) 00000100:00100000:3.0:1787827129.887249:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826496:0@lo:101: 00010000:00010000:1.0:1787827129.887255:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.887263:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827129.887278:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.887280:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a73c81d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6481:x1874672580826368:12345-0@lo:101: Request processed in 112us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.887280:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827129.887295:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 0000000046fe5129/0xb2e8bd65d71dd6e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd6e7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.887298:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787827129.887298:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580826624:0@lo:103: 00000100:00100000:3.0:1787827129.887303:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024741f7a going to sleep for 11 seconds 00010000:00010000:1.0:1787827129.887319:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827129.887322:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827129.887323:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826496 00010000:00010000:1.0:1787827129.887324:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827129.887329:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826496 00000100:00100000:2.0:1787827129.887336:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.887358:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826624 00000100:00100000:0.0:1787827129.887362:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826624 00000100:00100000:3.0:1787827129.887372:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787827129.887407:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2f8f487 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580826368:0@lo:101: 00000100:00100000:0.0:1787827129.887412:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827129.887412:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039e0f039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:7412:x1874672580826496:12345-0@lo:101: 00010000:00010000:2.0:1787827129.887421:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887422:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787827129.887423:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028bf502e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3615:x1874672580826624:12345-0@lo:103: 00010000:00010000:2.0:1787827129.887430:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887433:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827129.887433:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de8256bf/0xb2e8bd65d71dd703 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd6fc expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887442:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6e0 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887457:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827129.887459:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de8256bf/0xb2e8bd65d71dd703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6fc expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887466:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de8256bf/0xb2e8bd65d71dd703 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6fc expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887473:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de8256bf, rc 0) 00000100:00100000:2.0:1787827129.887480:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2f8f487 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580826752:0@lo:256: 00000100:00100000:0.0:1787827129.887485:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028bf502e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3615:x1874672580826624:12345-0@lo:103: Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.887491:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827129.887517:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.887526:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039e0f039 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:7412:x1874672580826496:12345-0@lo:101: Request processed in 120us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.887534:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787827129.887537:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826496:0@lo:101: 00000100:00100000:1.0:1787827129.887545:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826752 00000100:00100000:2.0:1787827129.887548:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000005361199a going to sleep for 11 seconds 00010000:00010000:0.0:1787827129.887550:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd703 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.887555:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826752 00010000:00010000:0.0:1787827129.887561:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd703 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827129.887575:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:2.0:1787827129.887583:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580826624:0@lo:103: 00010000:00010000:0.0:1787827129.887586:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd703 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.887593:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787827129.887594:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000003bc3bac8/0xb2e8bd65d71dd6fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd703 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.887604:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002463d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6481:x1874672580826752:12345-0@lo:256: 10000000:01000000:0.0:1787827129.887605:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f8bba965800 10000000:01000000:0.0:1787827129.887611:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787827129.887616:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f8bba965800 from 1 10000000:01000000:0.0:1787827129.887618:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 20000000:01000000:1.0:1787827129.887621:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00010000:00010000:0.0:1787827129.887632:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787827129.887636:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787827129.887642:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00010000:00010000:0.0:1787827129.887644:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887652:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.887664:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826880:0@lo:101: 00000100:00100000:0.0:1787827129.887698:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.887717:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.887717:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580826880 00000100:00100000:2.0:1787827129.887720:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580826880 00000100:00100000:1.0:1787827129.887742:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002463d6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580826752:12345-0@lo:256: Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.887749:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787827129.887756:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787827129.887759:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023a29070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:7412:x1874672580826880:12345-0@lo:101: 00010000:00010000:2.0:1787827129.887767:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787827129.887771:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2f8f487 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580826752:0@lo:256: 00010000:00010000:2.0:1787827129.887776:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f142b45f/0xb2e8bd65d71dd711 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd70a expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.887792:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f142b45f/0xb2e8bd65d71dd711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd70a expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.887800:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f142b45f/0xb2e8bd65d71dd711 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd70a expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.887813:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f142b45f, rc 0) 10000000:01000000:3.0:1787827129.887814:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787827129.887818:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.887824:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.887829:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787827129.887831:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787827129.887833:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787827129.887843:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.887848:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023a29070 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:7412:x1874672580826880:12345-0@lo:101: Request processed in 92us (150us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827129.887852:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.887855:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580826880:0@lo:101: 00000100:00100000:2.0:1787827129.887861:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1787827129.887865:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887870:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd711 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887883:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd711 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.887886:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827008:0@lo:101: 10000000:01000000:0.0:1787827129.887915:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787827129.887924:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd711 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.887931:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827129.887937:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000003d6174e0/0xb2e8bd65d71dd70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd711 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827129.887944:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787827129.887948:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:3.0:1787827129.887951:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000006547f8ba going to sleep for 11 seconds 10000000:01000000:0.0:1787827129.887952:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f8bba965800 00000100:00100000:1.0:1787827129.887956:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827008 10000000:01000000:0.0:1787827129.887957:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1787827129.887961:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827008 10000000:01000000:0.0:1787827129.887962:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787827129.887966:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787827129.887980:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.887985:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.887990:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1787827129.887992:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.888000:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000842006d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580827008:12345-0@lo:101: 00000100:00100000:0.0:1787827129.888004:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827136:0@lo:101: 00010000:00010000:1.0:1787827129.888010:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827129.888020:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df2ea0f2/0xb2e8bd65d71dd726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd718 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.888029:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827129.888038:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df2ea0f2/0xb2e8bd65d71dd726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 13 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827129.888047:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00010000:00010000:1.0:1787827129.888047:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df2ea0f2/0xb2e8bd65d71dd726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 13 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.888057:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df2ea0f2, rc 0) 00000100:00100000:2.0:1787827129.888064:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827136 00000100:00100000:2.0:1787827129.888076:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827136 00000100:00100000:1.0:1787827129.888090:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000842006d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580827008:12345-0@lo:101: Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.888097:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787827129.888109:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827008:0@lo:101: 00000100:00100000:2.0:1787827129.888110:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787827129.888122:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005624ef25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:7412:x1874672580827136:12345-0@lo:101: 00010000:00010000:3.0:1787827129.888126:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.888130:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827129.888135:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.888138:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042ae508c/0xb2e8bd65d71dd72d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd71f expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.888153:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042ae508c/0xb2e8bd65d71dd72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.888160:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042ae508c/0xb2e8bd65d71dd72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.888167:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042ae508c, rc 0) 00000100:00100000:3.0:1787827129.888174:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827264:0@lo:501: 00000100:00100000:2.0:1787827129.888203:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005624ef25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827136:12345-0@lo:101: Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.888211:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.888213:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827136:0@lo:101: 00000100:00100000:2.0:1787827129.888214:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787827129.888223:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.888230:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.888239:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000006547f8ba going to sleep for 11 seconds 00000100:00100000:1.0:1787827129.888240:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827264 00000100:00100000:1.0:1787827129.888246:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827264 00000100:00100000:1.0:1787827129.888282:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787827129.888290:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f08564fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580827264:12345-0@lo:501: 00000100:00100000:0.0:1787827129.888304:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827392:0@lo:501: 00000100:00100000:0.0:1787827129.888329:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.888347:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.888352:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827392 00000100:00100000:2.0:1787827129.888356:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827392 00000100:00100000:1.0:1787827129.888375:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f08564fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580827264:12345-0@lo:501: Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.888413:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787827129.888423:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787827129.888430:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827264:0@lo:501: 00000100:00100000:2.0:1787827129.888434:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bf1b0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827392:12345-0@lo:501: 00000100:00100000:3.0:1787827129.888459:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827520:0@lo:503: 00000100:00100000:3.0:1787827129.888493:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.888516:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827520 00000100:00100000:2.0:1787827129.888521:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bf1b0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827392:12345-0@lo:501: Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.888522:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827520 00000100:00100000:3.0:1787827129.888528:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000006547f8ba going to sleep for 11 seconds 00000100:00100000:0.0:1787827129.888530:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827392:0@lo:501: 00000100:00100000:2.0:1787827129.888536:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787827129.888559:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827648:0@lo:503: 00000100:00100000:1.0:1787827129.888561:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787827129.888571:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd44e673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580827520:12345-0@lo:503: 00000100:00100000:0.0:1787827129.888596:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.888614:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbcb0c1e going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.888616:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827648 00000100:00100000:3.0:1787827129.888621:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827648 00000100:00100000:1.0:1787827129.888648:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd44e673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580827520:12345-0@lo:503: Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.888655:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787827129.888663:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787827129.888667:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580827520:0@lo:503: 00000100:00100000:3.0:1787827129.888667:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ae30954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:7412:x1874672580827648:12345-0@lo:503: 00000100:00100000:3.0:1787827129.888741:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ae30954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827648:12345-0@lo:503: Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.888749:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787827129.888754:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827648:0@lo:503: 00000100:00100000:2.0:1787827129.888855:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b35ccc8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7428:1874672580827776:0@lo:502: 00000100:00100000:2.0:1787827129.888885:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.888913:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 000000004fe5fb35 going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.888917:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827776 00000100:00100000:3.0:1787827129.888927:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827776 00000100:00100000:3.0:1787827129.888955:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787827129.888963:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdfee2b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7428:x1874672580827776:12345-0@lo:502: 00000040:00080000:0.0:1787827129.889004:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827129.889027:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdfee2b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7428:x1874672580827776:12345-0@lo:502: Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.889033:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787827129.889051:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b35ccc8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7428:1874672580827776:0@lo:502: 00000100:00100000:0.0:1787827129.889055:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827904:0@lo:502: 00000020:01000000:2.0:1787827129.889072:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827129.889078:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827129.889081:0:7428:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787827129.889084:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1787827129.889086:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1787827129.889087:0:7428:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000100:00100000:0.0:1787827129.889104:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000009dffdcf8 going to sleep for 11 seconds 00000020:00000080:2.0:1787827129.889106:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:1.0:1787827129.889118:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580827904 00000020:00000080:2.0:1787827129.889118:0:7428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000061f644bb) 00000100:00100000:1.0:1787827129.889124:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580827904 00000020:00000080:2.0:1787827129.889136:0:7428:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787827129.889143:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1787827129.889152:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787827129.889161:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b576650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827904:12345-0@lo:502: 00000004:00080000:2.0:1787827129.889226:0:7428:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787827129.889231:0:7428:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000100:00100000:1.0:1787827129.889235:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b576650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580827904:12345-0@lo:502: Request processed in 76us (148us total) trans 0 rc 0/0 00000020:00000080:2.0:1787827129.889238:0:7428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd73b 00000100:00100000:1.0:1787827129.889246:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787827129.889250:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580827904:0@lo:502: 00010000:00080000:2.0:1787827129.889270:0:7428:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a3a9082e@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.129@tcp at head 00000040:00080000:0.0:1787827129.889447:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787827129.889468:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1787827129.889482:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1787827129.889494:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1787827129.889505:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1787827129.889517:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1787827129.889529:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1787827129.889540:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1787827129.889551:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1787827129.889564:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1787827129.889576:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1787827129.889588:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1787827129.889599:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1787827129.889621:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1787827129.889632:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1787827129.889643:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1787827129.889656:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1787827129.889668:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1787827129.889678:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1787827129.889690:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1787827129.889702:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1787827129.889713:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1787827129.889724:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1787827129.889741:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580828032:0@lo:502: 00000100:00100000:0.0:1787827129.889773:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.889800:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000009dffdcf8 going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.889808:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828032 00000100:00100000:3.0:1787827129.889812:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828032 00000100:00100000:3.0:1787827129.889832:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787827129.889837:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fcd3ef4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580828032:12345-0@lo:502: 00000100:00100000:3.0:1787827129.889891:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fcd3ef4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7412:x1874672580828032:12345-0@lo:502: Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.889909:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787827129.889915:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580828032:0@lo:502: 00000040:00080000:0.0:1787827129.889954:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1787827129.889960:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1787827129.890196:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827129.890202:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827129.890203:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787827129.890207:0:7429:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787827129.890209:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787827129.890217:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d956514e) 00000020:00000080:0.0:1787827129.891097:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lod with refcount 2 00000020:00000080:0.0:1787827129.891107:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787827129.891181:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787827129.891186:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dd749 00000020:00000080:0.0:1787827129.891373:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787827129.891392:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827129.891397:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827129.891399:0:7429:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787827129.891402:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827129.891410:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827129.891411:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787827129.891416:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787827129.891424:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000813e1639) 00000020:00000080:0.0:1787827129.891433:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdt with refcount 2 00000020:00000080:0.0:1787827129.891437:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787827129.891438:0:7429:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787827129.891441:0:7429:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787827129.891446:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787827129.891480:0:7429:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0ad83bd from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787827129.891496:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000de136ed2) 00000020:00000080:0.0:1787827129.891505:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdd with refcount 2 00000004:01000000:0.0:1787827129.891555:0:7429:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00010000:00010000:2.0:1787827129.891556:0:7428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:0.0:1787827129.891560:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dd75e 00000020:00000080:0.0:1787827129.891649:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787827129.891655:0:7429:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787827129.891661:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb2e8bd65d71dd765 00080000:01000000:0.0:1787827129.891667:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787827129.891671:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dd76c 00080000:10000000:0.0:1787827129.892020:0:7429:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787827129.892158:0:7429:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000020:00000080:1.0:1787827129.892242:0:7428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787827129.892249:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787827129.892275:0:7428:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787827129.892286:0:7428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71dd773 00000100:00080000:1.0:1787827129.892293:0:7428:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827129.892297:0:7428:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a3a9082e using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827129.892319:0:7428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008ad1f926 x1874672580828160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827129.892349:0:7428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787827129.892404:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580828160:0@lo:38: 00000040:01000000:1.0:1787827129.892420:0:7428:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1787827129.892437:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e63874c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580828288:0@lo:400: 00000100:00100000:2.0:1787827129.892461:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.892475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.892494:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828160 00000100:00100000:1.0:1787827129.892500:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828160 00000100:00100000:1.0:1787827129.892530:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787827129.892535:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35ccc8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1874672580828160:12345-0@lo:38: 00000100:00100000:3.0:1787827129.892536:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828288 00000100:00100000:3.0:1787827129.892541:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828288 00010000:02000000:1.0:1787827129.892550:0:6489:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:3.0:1787827129.892576:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827129.892581:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4bc0127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580828288:12345-0@lo:400: 00000100:00100000:3.0:1787827129.892615:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4bc0127 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580828288:12345-0@lo:400: Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.892620:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787827129.892646:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002e63874c x1874672580828288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827129.892659:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e63874c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580828288:0@lo:400: 00000100:00080000:3.0:1787827129.894661:0:7432:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000000f2ef0a2 x1874672580828416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827129.894671:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00000020:01000000:2.0:1787827129.894744:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827129.894753:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827129.894755:0:7428:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787827129.894758:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827129.894760:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827129.894761:0:7428:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787827129.894763:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787827129.894765:0:7428:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787827129.894782:0:7428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d204ecab pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7428:1874672580828544:0@lo:502: 00000100:00100000:2.0:1787827129.894822:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.894855:0:7428:0:(client.c:2715:ptlrpc_set_wait()) set 000000004dec7bc3 going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.894869:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828544 00000100:00100000:3.0:1787827129.894875:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828544 00000100:00100000:3.0:1787827129.894938:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787827129.894946:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c25295a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7428:x1874672580828544:12345-0@lo:502: 00000100:00100000:3.0:1787827129.895038:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c25295a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:7428:x1874672580828544:12345-0@lo:502: Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.895046:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787827129.895053:0:7428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d204ecab pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:7428:1874672580828544:0@lo:502: 00000020:01000000:2.0:1787827129.895077:0:7428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827129.895081:0:7428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827129.895083:0:7428:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787827129.895085:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787827129.896885:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787827129.896921:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787827129.896929:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.896939:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000000459c5b8/0xb2e8bd65d71dd718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827129.896948:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787827129.896950:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b988b19b8 from 1 10000000:01000000:1.0:1787827129.896953:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787827129.896975:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.896982:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.896991:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.897004:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580828672:0@lo:101: 00000100:00100000:1.0:1787827129.897038:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.897080:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bf9d476 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.897085:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828672 00000100:00100000:2.0:1787827129.897091:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828672 00000100:00100000:1.0:1787827129.897125:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35ccc8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1874672580828160:12345-0@lo:38: Request processed in 4587us (4664us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787827129.897128:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787827129.897141:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a21c7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580828672:12345-0@lo:101: 00000100:00100000:1.0:1787827129.897142:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787827129.897151:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827129.897161:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000043dba7/0xb2e8bd65d71dd781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd77a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787827129.897167:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000a3a9082e lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787827129.897174:0:3612:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00010000:00010000:2.0:1787827129.897179:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000043dba7/0xb2e8bd65d71dd781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.897179:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1f926 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580828160:0@lo:38: 00010000:00010000:2.0:1787827129.897196:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000043dba7/0xb2e8bd65d71dd781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.897202:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000043dba7, rc 0) 00000100:00100000:2.0:1787827129.897235:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a21c7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580828672:12345-0@lo:101: Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.897239:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787827129.897261:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580828672:0@lo:101: 00010000:00010000:1.0:1787827129.897272:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.897280:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.897329:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580828800:0@lo:501: 00000100:00100000:1.0:1787827129.897351:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.897365:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bf9d476 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.897398:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828800 00000100:00100000:2.0:1787827129.897403:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828800 00000100:00100000:2.0:1787827129.897431:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787827129.897438:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d405b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580828800:12345-0@lo:501: 00000100:00100000:2.0:1787827129.897501:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d405b70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580828800:12345-0@lo:501: Request processed in 63us (149us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787827129.897516:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787827129.897518:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580828800:0@lo:501: 10000000:01000000:1.0:1787827129.897543:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787827129.897546:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.897552:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000005695e315/0xb2e8bd65d71dd77a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827129.961175:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1787827129.961355:0:7429:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1787827129.962914:0:7429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787827129.963070:0:7429:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787827129.967053:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787827129.967065:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827129.967076:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.967079:0:7429:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787827129.967083:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827129.967088:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.967090:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787827129.967100:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787827129.967106:0:7429:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:1.0:1787827129.967132:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787827129.967155:0:7429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000008ae88a5e) 00000020:00000080:1.0:1787827129.967183:0:7429:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osp with refcount 2 00000020:00000080:1.0:1787827129.967190:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787827129.967282:0:7429:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787827129.967289:0:7429:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787827129.967296:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dd78f 00010000:00080000:1.0:1787827129.967329:0:7429:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d75274d9@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787827129.972011:0:7429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-3 is initialized 00000020:00000080:1.0:1787827129.972624:0:7429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787827129.972635:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787827129.972666:0:7429:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787827129.972684:0:7429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dd796 00000100:00080000:1.0:1787827129.972694:0:7429:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827129.972698:0:7429:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d75274d9 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827129.972728:0:7429:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000058d5bd78 x1874672580828928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827129.972745:0:7429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787827129.972774:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580828928:0@lo:38: 00000020:01000000:1.0:1787827129.972789:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827129.972793:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972794:0:7429:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787827129.972796:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787827129.972798:0:7429:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787827129.972799:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787827129.972800:0:7429:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787827129.972801:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787827129.972803:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972804:0:7429:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787827129.972805:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827129.972813:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972814:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787827129.972816:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787827129.972842:0:7429:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787827129.972850:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827129.972852:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972853:0:7429:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787827129.972854:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827129.972856:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972857:0:7429:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787827129.972859:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787827129.972860:0:7429:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787827129.972870:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787827129.972879:0:7429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827129.972882:0:7429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827129.972883:0:7429:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787827129.972885:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:2.0:1787827129.972923:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828928 00000100:00100000:2.0:1787827129.972931:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828928 00000020:01000000:3.0:1787827129.972955:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:2.0:1787827129.972968:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827129.972976:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e63874c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1874672580828928:12345-0@lo:38: 10000000:01000000:3.0:1787827129.972986:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00080000:2.0:1787827129.972997:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 82 last 0 00010000:00010000:3.0:1787827129.973002:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.973013:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000c108799f/0xb2e8bd65d71dd71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.973020:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8bba965800 from 1 10000000:01000000:3.0:1787827129.973023:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000080:2.0:1787827129.973024:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dd79d 00000004:00100000:2.0:1787827129.973038:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787827129.973042:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787827129.973045:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.973065:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.973073:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.973100:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829056:0@lo:101: 00000100:00100000:3.0:1787827129.973129:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.973147:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad657ed2 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.973162:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829056 00000100:00100000:2.0:1787827129.973166:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829056 00000100:00100000:2.0:1787827129.973197:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787827129.973202:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5cee768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:7412:x1874672580829056:12345-0@lo:101: 00010000:00010000:2.0:1787827129.973213:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827129.973223:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd7a4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.973241:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.973262:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.973270:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be3023f7, rc 0) 00000100:00100000:2.0:1787827129.973307:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5cee768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:7412:x1874672580829056:12345-0@lo:101: Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.973314:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787827129.973335:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829056:0@lo:101: 00010000:00010000:3.0:1787827129.973346:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.973351:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.973870:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829184:0@lo:256: 00000100:00100000:3.0:1787827129.973914:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.973938:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad657ed2 going to sleep for 11 seconds 00000100:00100000:1.0:1787827129.973956:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829184 00000100:00100000:1.0:1787827129.973961:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829184 00000100:00100000:1.0:1787827129.973994:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787827129.974000:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dae5f759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:7412:x1874672580829184:12345-0@lo:256: 20000000:01000000:1.0:1787827129.974011:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787827129.974022:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787827129.974024:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787827129.974086:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dae5f759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:7412:x1874672580829184:12345-0@lo:256: Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.974092:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787827129.974102:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829184:0@lo:256: 10000000:01000000:3.0:1787827129.974696:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787827129.974708:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.974716:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.974723:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8bba965800 from 1 10000000:01000000:3.0:1787827129.974726:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787827129.974749:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.974755:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.974765:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.974776:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829312:0@lo:101: 00000100:00100000:3.0:1787827129.974800:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.974822:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad657ed2 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.974838:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829312 00000100:00100000:2.0:1787827129.974843:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829312 00000100:00100000:2.0:1787827129.974877:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787827129.974885:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007af564ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:7412:x1874672580829312:12345-0@lo:101: 00010000:00010000:2.0:1787827129.974902:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827129.974910:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd7b2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.974925:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.974933:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.974940:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071a1a6ac, rc 0) 00000100:00100000:2.0:1787827129.974970:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007af564ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829312:12345-0@lo:101: Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.974977:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787827129.974989:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829312:0@lo:101: 00010000:00010000:3.0:1787827129.975000:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.975007:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.975065:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829440:0@lo:501: 00000100:00100000:3.0:1787827129.975089:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.975105:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad657ed2 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.975125:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829440 00000100:00100000:2.0:1787827129.975129:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829440 00000100:00100000:2.0:1787827129.975156:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787827129.975167:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb51677c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829440:12345-0@lo:501: 00000100:00100000:2.0:1787827129.975253:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb51677c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829440:12345-0@lo:501: Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.975260:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787827129.975282:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829440:0@lo:501: 00000100:00100000:3.0:1787827129.975306:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829568:0@lo:503: 00000100:00100000:3.0:1787827129.975342:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.975356:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad657ed2 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.975371:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829568 00000100:00100000:2.0:1787827129.975404:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829568 00000100:00100000:2.0:1787827129.975432:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787827129.975440:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5231b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829568:12345-0@lo:503: 00000040:00080000:2.0:1787827129.975467:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787827129.975517:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5231b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829568:12345-0@lo:503: Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.975524:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787827129.975539:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829568:0@lo:503: 00000100:00080000:1.0:1787827129.975730:0:6490:0:(import.c:65:import_set_state_nolock()) 000000005dd4074d : changing import state from RECOVER to FULL 00000040:00080000:3.0:1787827129.975755:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787827129.975772:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e63874c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3612:x1874672580828928:12345-0@lo:38: Request processed in 2796us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.975781:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827129.975799:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787827129.975805:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000040:00080000:3.0:1787827129.975809:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000100:00080000:2.0:1787827129.975812:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787827129.975818:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787827129.975820:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000d75274d9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827129.975836:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058d5bd78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580828928:0@lo:38: 00000040:00080000:3.0:1787827129.975883:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787827129.975905:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580829696:0@lo:41: 00000100:00100000:2.0:1787827129.975934:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.975979:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829696 00000100:00100000:0.0:1787827129.975985:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829696 00000100:00100000:0.0:1787827129.976012:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827129.976018:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d204ecab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1874672580829696:12345-0@lo:41: 00000004:00000024:0.0:1787827129.976037:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1787827129.976087:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d204ecab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1874672580829696:12345-0@lo:41: Request processed in 70us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.976098:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827129.976116:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd5a9591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580829696:0@lo:41: 00000040:00080000:2.0:1787827129.976671:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787827129.976725:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787827129.976748:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827129.976761:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.976770:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827129.976808:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787827129.976811:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8bba965800 10000000:01000000:3.0:1787827129.976814:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8bba965800 10000000:01000000:3.0:1787827129.976817:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787827129.976821:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bba965800 from 1 10000000:01000000:3.0:1787827129.976824:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827129.976837:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.976844:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.976851:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.976863:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829824:0@lo:101: 00000100:00100000:3.0:1787827129.976889:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.976929:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a44d26 going to sleep for 11 seconds 00000100:00100000:1.0:1787827129.976943:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829824 00000100:00100000:1.0:1787827129.976951:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829824 00000100:00100000:1.0:1787827129.976973:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787827129.976976:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050c9b418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:7412:x1874672580829824:12345-0@lo:101: 00010000:00010000:1.0:1787827129.976982:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827129.976989:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b0085d3c/0xb2e8bd65d71dd7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd7c0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.977000:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b0085d3c/0xb2e8bd65d71dd7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.977005:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b0085d3c/0xb2e8bd65d71dd7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.977010:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b0085d3c, rc 0) 00000100:00100000:1.0:1787827129.977034:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050c9b418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580829824:12345-0@lo:101: Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.977038:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787827129.977064:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829824:0@lo:101: 00010000:00010000:3.0:1787827129.977075:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827129.977094:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827129.977145:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829952:0@lo:501: 00000100:00100000:3.0:1787827129.977170:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.977190:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a44d26 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.977203:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580829952 00000100:00100000:2.0:1787827129.977208:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580829952 00000100:00100000:2.0:1787827129.977232:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787827129.977238:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cdec418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580829952:12345-0@lo:501: 00000100:00100000:2.0:1787827129.977300:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cdec418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580829952:12345-0@lo:501: Request processed in 63us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.977312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787827129.977314:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580829952:0@lo:501: 00000100:00100000:3.0:1787827129.977340:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830080:0@lo:503: 00000100:00100000:3.0:1787827129.977371:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.977429:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a44d26 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.977446:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830080 00000100:00100000:2.0:1787827129.977450:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830080 00000100:00100000:2.0:1787827129.977472:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787827129.977477:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097febd9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830080:12345-0@lo:503: 00000100:00100000:2.0:1787827129.977534:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097febd9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830080:12345-0@lo:503: Request processed in 57us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.977542:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787827129.977550:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830080:0@lo:503: 00000040:00080000:3.0:1787827129.977687:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827129.977729:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830208:0@lo:502: 00000100:00100000:3.0:1787827129.977762:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.977781:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a44d26 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.977795:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830208 00000100:00100000:2.0:1787827129.977800:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830208 00000100:00100000:2.0:1787827129.977821:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787827129.977827:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062c392e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830208:12345-0@lo:502: 00000100:00100000:2.0:1787827129.977888:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062c392e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830208:12345-0@lo:502: Request processed in 61us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.977908:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787827129.977917:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830208:0@lo:502: 00000040:00080000:3.0:1787827129.978049:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787827129.978066:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787827129.978074:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787827129.978081:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787827129.978088:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787827129.978097:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787827129.978110:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787827129.978123:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787827129.978135:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787827129.978148:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787827129.978167:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787827129.978175:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787827129.978181:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787827129.978188:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787827129.978197:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787827129.978205:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787827129.978211:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787827129.978218:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787827129.978224:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787827129.978230:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787827129.978236:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787827129.978243:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787827129.978249:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787827129.978255:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787827129.978261:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787827129.978268:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787827129.978274:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787827129.978280:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1787827129.978292:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830336:0@lo:502: 00000100:00100000:3.0:1787827129.978314:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.978330:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a44d26 going to sleep for 11 seconds 00000100:00100000:1.0:1787827129.978354:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830336 00000100:00100000:1.0:1787827129.978359:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830336 00000100:00100000:1.0:1787827129.978404:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787827129.978411:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a48f8236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830336:12345-0@lo:502: 00000100:00100000:1.0:1787827129.978509:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a48f8236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830336:12345-0@lo:502: Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.978516:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787827129.978528:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830336:0@lo:502: 00000040:00080000:3.0:1787827129.978566:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787827129.978573:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787827129.978831:0:7438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787827129.978842:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000438d67da) 00000020:00000080:3.0:1787827129.978854:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type lwp with refcount 2 00000020:01000004:3.0:1787827129.978928:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d0ad83bd from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787827129.978931:0:7438:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d0ad83bd from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787827129.978933:0:7438:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d0ad83bd 3 00010000:00080000:3.0:1787827129.978950:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010bfc960@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787827129.983090:0:7438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-4 is initialized 00000020:00000080:3.0:1787827129.983263:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787827129.983302:0:7438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787827129.983313:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb2e8bd65d71dd7d5 00000100:00080000:3.0:1787827129.983320:0:7438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827129.983325:0:7438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000010bfc960 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787827129.983351:0:7438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e60a3244 x1874672580830464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787827129.983373:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787827129.983446:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1874672580830464:0@lo:38: 00000100:00100000:2.0:1787827129.983500:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827129.983532:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830464 00000100:00100000:3.0:1787827129.983538:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830464 00000100:00100000:3.0:1787827129.983573:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827129.983579:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0fe9c76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1874672580830464:12345-0@lo:38: 00010000:00080000:3.0:1787827129.983600:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 82 last 0 00000020:00000080:3.0:1787827129.983636:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb2e8bd65d71dd7dc 00000004:00100000:3.0:1787827129.983649:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787827129.983672:0:6486:0:(import.c:65:import_set_state_nolock()) 00000000e3804180 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827129.983725:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0fe9c76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3612:x1874672580830464:12345-0@lo:38: Request processed in 145us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.983734:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787827129.983752:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e60a3244 x1874672580830464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827129.983763:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787827129.983770:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1787827129.983776:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787827129.983781:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787827129.983784:0:3612:0:(import.c:65:import_set_state_nolock()) 0000000010bfc960 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827129.983790:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e60a3244 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1874672580830464:0@lo:38: 00000040:00080000:3.0:1787827129.983810:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1787827129.983837:0:7439:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1787827129.983879:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787827129.983925:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827129.983941:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.983951:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000b1f3080f/0xb2e8bd65d71dd7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787827129.983993:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787827129.983995:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787827129.983996:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827129.983998:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827129.983999:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827129.984001:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827129.984002:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827129.984004:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827129.984005:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827129.984006:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827129.984007:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827129.984010:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1787827129.984013:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787827129.984015:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787827129.984016:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827129.984017:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827129.984018:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827129.984019:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827129.984021:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787827129.984029:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827129.984031:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827129.984032:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827129.984032:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827129.984045:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787827129.984055:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830592:0@lo:253: 00000100:00100000:2.0:1787827129.984091:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.984114:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017cd8c5a going to sleep for 11 seconds 00000100:00100000:3.0:1787827129.984123:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830592 00000100:00100000:3.0:1787827129.984129:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830592 00000100:00100000:3.0:1787827129.984165:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787827129.984175:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004221220f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830592:12345-0@lo:253: 20000000:01000000:3.0:1787827129.984194:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787827129.984208:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787827129.985137:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787827129.985180:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787827129.985196:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787827129.985205:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787827129.985210:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787827129.985226:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985245:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 18 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985253:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985258:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985282:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985293:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.985305:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdea1816 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580830720:0@lo:104: 00000100:00100000:1.0:1787827129.985348:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.985366:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004221220f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:7412:x1874672580830592:12345-0@lo:253: Request processed in 1193us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.985401:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787827129.985411:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:7412:1874672580830592:0@lo:253: 00010000:00010000:1.0:1787827129.985415:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985424:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827129.985426:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787827129.985432:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787827129.985435:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:1.0:1787827129.985436:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074481bca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580830848:0@lo:104: 00000020:01000004:0.0:1787827129.985438:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:2.0:1787827129.985438:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830720 00000020:01000004:0.0:1787827129.985443:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:2.0:1787827129.985444:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830720 00000020:01000004:0.0:1787827129.985445:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827129.985449:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827129.985450:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787827129.985452:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827129.985453:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827129.985454:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827129.985455:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787827129.985465:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:0.0:1787827129.985472:0:7412:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787827129.985482:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d998e5db going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.985495:0:7424:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787827129.985505:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1787827129.985508:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830848 00000100:00100000:2.0:1787827129.985513:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830848 00000100:00100000:1.0:1787827129.985518:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787827129.985537:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000084da2e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580830720:12345-0@lo:104: 00000100:00100000:2.0:1787827129.985543:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787827129.985552:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.985556:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c53307cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580830848:12345-0@lo:104: 00010000:00010000:2.0:1787827129.985567:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985593:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787827129.985598:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000084da2e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580830720:12345-0@lo:104: Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.985603:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787827129.985624:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787827129.985628:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787827129.985632:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c53307cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580830848:12345-0@lo:104: Request processed in 79us (167us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827129.985633:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.985646:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787827129.985648:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019cf7a48 already unused, calling callback (00000000f4bdffda) 10000000:00010000:1.0:1787827129.985653:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985661:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827129.985667:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827129.985673:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827129.985690:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827129.985699:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985704:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827129.985715:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985719:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 0000000019cf7a48/0xb2e8bd65d71dd7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ab expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985734:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827129.985735:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827129.985737:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827129.985750:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010bc5120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580830976:0@lo:103: 00000100:00100000:1.0:1787827129.985774:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827129.985799:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580830976 00000100:00100000:1.0:1787827129.985802:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580830976 00010000:00010000:2.0:1787827129.985805:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827129.985812:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985816:0:7425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.985825:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cdc489d7 already unused, calling callback (00000000f4bdffda) 10000000:00010000:2.0:1787827129.985828:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.985836:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.985839:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787827129.985847:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c7076c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3614:x1874672580830976:12345-0@lo:103: 00010000:00010000:1.0:1787827129.985854:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827129.985859:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827129.985860:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.985872:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 18 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827129.985874:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787827129.985887:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827129.985914:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.985922:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787827129.985924:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c7076c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3614:x1874672580830976:12345-0@lo:103: Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827129.985929:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787827129.985939:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.985947:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000cdc489d7/0xb2e8bd65d71dd6ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6f5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827129.985960:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010bc5120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580830976:0@lo:103: 00010000:00010000:2.0:1787827129.985963:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827129.985967:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827129.985970:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827129.985980:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be3023f7/0xb2e8bd65d71dd7ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7a4 expref: 17 pid: 6479 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.985983:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580831104:0@lo:103: 00000100:00100000:1.0:1787827129.985999:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdea1816 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580830720:0@lo:104: 00000100:00100000:1.0:1787827129.986009:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074481bca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580830848:0@lo:104: 00000100:00100000:2.0:1787827129.986019:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827129.986025:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.986068:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831104 00000100:00100000:2.0:1787827129.986072:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831104 00010000:00010000:2.0:1787827129.986085:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.986115:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787827129.986122:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005719a303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3615:x1874672580831104:12345-0@lo:103: 00010000:00010000:2.0:1787827129.986130:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827129.986133:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986148:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986158:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b77b65a7/0xb2e8bd65d71dd6f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6ee expref: 17 pid: 7426 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986168:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986175:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787827129.986186:0:6471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000976559s 00010000:00010000:2.0:1787827129.986189:0:6471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986195:0:6471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986201:0:6471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986206:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986211:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041ba4a3e already unused, calling callback (000000005d28ebf6) 00010000:00010000:2.0:1787827129.986214:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986221:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986242:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827129.986251:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827129.986257:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.986266:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827129.986272:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041ba4a3e/0xb2e8bd65d71dd7e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827129.986280:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005719a303 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3615:x1874672580831104:12345-0@lo:103: Request processed in 158us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.986287:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787827129.986328:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580831104:0@lo:103: 00010000:00010000:2.0:1787827129.986343:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827129.986345:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787827129.988740:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1787827129.988914:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787827129.989092:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787827129.989250:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787827129.989375:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787827129.989582:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787827129.990207:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787827129.990455:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787827129.990619:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1787827129.990763:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1787827129.990943:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1787827129.991097:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1787827129.992055:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787827129.992066:0:7444:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787827129.992072:0:7444:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787827129.992283:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787827129.992290:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787827129.992331:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1874672580831232:0@lo:700: 00000100:00100000:3.0:1787827129.992412:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.992464:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831232 00000100:00100000:3.0:1787827129.992467:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c01cf1a1 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.992472:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831232 00000100:00100000:2.0:1787827129.992516:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827129.992525:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031a67975 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1874672580831232:12345-0@lo:700: 00000100:00100000:3.0:1787827129.992527:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 2 min 2 max 256 00000100:00100000:3.0:1787827129.992536:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0002' 00000100:00100000:0.0:1787827129.992544:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831360:0@lo:1000: 00000100:00100000:0.0:1787827129.992598:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827129.992617:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831360 00000100:00100000:2.0:1787827129.992622:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831360 00000100:00100000:0.0:1787827129.992626:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b2e1abb going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.992653:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787827129.992660:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787827129.992667:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787827129.992676:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b9833ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831360:12345-0@lo:1000: 00000100:00100000:2.0:1787827129.992751:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b9833ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831360:12345-0@lo:1000: Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.992768:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787827129.992782:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831360:0@lo:1000: 00000040:01000000:0.0:1787827129.992810:0:7446:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787827129.992834:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831488:0@lo:700: 00000100:00100000:0.0:1787827129.992861:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.992880:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df467dd3 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.992889:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831488 00000100:00100000:2.0:1787827129.992905:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831488 00000100:00100000:2.0:1787827129.992936:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827129.992951:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f435f39 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831488:12345-0@lo:700: 00000040:01000000:1.0:1787827129.992961:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1787827129.993001:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f435f39 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831488:12345-0@lo:700: Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.993006:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831488:0@lo:700: 00000100:00100000:2.0:1787827129.993012:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787827129.993043:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1874672580831616:0@lo:900: 00000040:00080000:1.0:1787827129.993071:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787827129.993074:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.993091:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df467dd3 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.993111:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831616 00000100:00100000:2.0:1787827129.993116:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831616 00000100:00100000:2.0:1787827129.993142:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827129.993147:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097855df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1874672580831616:12345-0@lo:900: 00000100:00100000:2.0:1787827129.993183:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097855df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7446:x1874672580831616:12345-0@lo:900: Request processed in 37us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.993190:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787827129.993200:0:7446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008ddf8508 x1874672580831616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787827145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827129.993211:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7446:1874672580831616:0@lo:900: 00000100:00100000:0.0:1787827129.993252:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831744:0@lo:1000: 00000100:00100000:0.0:1787827129.993276:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.993291:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ab808f57 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.993295:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580831744 00000100:00100000:2.0:1787827129.993299:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580831744 00000100:00100000:2.0:1787827129.993317:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787827129.993321:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000434c6d12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831744:12345-0@lo:1000: 00000100:00100000:2.0:1787827129.993363:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000434c6d12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580831744:12345-0@lo:1000: Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827129.993370:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787827129.993395:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580831744:0@lo:1000: 00000004:00080000:0.0:1787827129.993433:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000df467dd3 with version 0 00000020:00100000:0.0:1787827129.993445:0:7446:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787827129.993449:0:7446:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000008ddf8508 x1874672580832000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787827129.993461:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580832000:0@lo:1000: 00000100:00100000:0.0:1787827129.993481:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.993496:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007b8e6bf going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.993498:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832000 00000100:00100000:2.0:1787827129.993503:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832000 00000100:00100000:2.0:1787827129.993518:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787827129.993522:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5a9591 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580832000:12345-0@lo:1000: 00000004:00000080:1.0:1787827129.993598:0:7412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787827129.993616:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787827129.993733:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827129.994596:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000001:00080000:0.0:1787827129.994760:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:3.0:1787827129.994804:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1787827129.994835:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5a9591 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580832000:12345-0@lo:1000: Request processed in 1311us (1352us total) trans 4294967297 rc 0/0 00000004:00080000:0.0:1787827129.994845:0:7446:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787827129.994848:0:7446:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787827129.994851:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787827129.994860:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580832000:0@lo:1000: 00000100:00100000:0.0:1787827129.994921:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580832128:0@lo:1000: 00000100:00100000:0.0:1787827129.994943:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827129.994958:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832128 00000100:00100000:0.0:1787827129.994961:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832128 00000100:00100000:0.0:1787827129.994983:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827129.994989:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c94c03b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580832128:12345-0@lo:1000: 00000100:00100000:0.0:1787827129.995034:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c94c03b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7446:x1874672580832128:12345-0@lo:1000: Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827129.995041:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827129.995061:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b2e1abb going to sleep for 11 seconds 00000100:00100000:0.0:1787827129.995070:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7446:1874672580832128:0@lo:1000: 00000040:00080000:1.0:1787827129.995070:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:00080000:0.0:1787827129.995092:0:7446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787827129.995103:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000004:00080000:0.0:1787827129.995110:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000df467dd3 with version 1 00000004:00080000:2.0:1787827129.995147:0:7435:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f650fb54 version 1 rpc_version 1 00000020:00100000:2.0:1787827129.995163:0:7435:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787827129.995168:0:7435:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000431e63b1 x1874672580832384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827129.995180:0:7435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1874672580832384:0@lo:1000: 00000100:00100000:2.0:1787827129.995206:0:7435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787827129.995218:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787827129.995220:0:7435:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9f4aff0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827129.995230:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832384 00000100:00100000:2.0:1787827129.995234:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832384 00000100:00100000:2.0:1787827129.995262:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787827129.995267:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028bf502e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7435:x1874672580832384:12345-0@lo:1000: 00080000:10000000:1.0:1787827129.995396:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787827129.995950:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787827129.996077:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787827129.996214:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000001:00080000:2.0:1787827129.996240:0:6463:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1787827129.996291:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028bf502e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7435:x1874672580832384:12345-0@lo:1000: Request processed in 1024us (1085us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787827129.996300:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1787827129.996324:0:7435:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787827129.996327:0:7435:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787827129.996337:0:7435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7435:1874672580832384:0@lo:1000: 00100000:10000000:1.0:1787827129.996342:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787827129.996502:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787827129.996647:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787827129.996750:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000040:00080000:0.0:1787827129.996832:0:7446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787827129.996877:0:7446:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1787827129.996887:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787827129.997026:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787827129.997108:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787827129.997198:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787827129.997301:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787827129.997453:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787827129.997561:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787827129.997654:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787827129.997767:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787827129.998005:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787827129.998111:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787827129.998228:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787827129.998372:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787827129.998517:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787827129.998596:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787827129.998717:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000100:00100000:3.0:1787827129.998845:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031a67975 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7445:x1874672580831232:12345-0@lo:700: Request processed in 6320us (6432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827129.998855:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787827129.998877:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006fda38ad x1874672580831232/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787827145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00100000:10000000:1.0:1787827129.998880:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:0.0:1787827129.998904:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7445:1874672580831232:0@lo:700: 40000000:02000000:0.0:1787827129.998915:0:7445:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1787827129.999020:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787827129.999106:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787827129.999233:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787827129.999367:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787827129.999497:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787827129.999588:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787827129.999709:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787827129.999840:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787827130.000021:0:7412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787827130.002552:0:7412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787827130.002586:0:7412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9e9b417c3988 00100000:10000000:1.0:1787827130.002593:0:7412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787827130.002849:0:7412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787827130.002876:0:7412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787827130.002907:0:7412:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787827130.002921:0:7412:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787827130.003758:0:7412:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827130.003960:0:7412:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787827130.006461:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787827130.012748:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827130.016537:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787827130.016606:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1787827130.016612:0:7445:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:3.0:1787827130.903436:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00010000:00010000:2.0:1787827131.031500:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827131.381403:0:7692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1787827131.721923:0:7744:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827131.722063:0:7744:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787827131.927508:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00010000:00010000:3.0:1787827132.054529:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827132.950484:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00010000:00010000:1.0:1787827133.078456:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787827133.357075:0:7845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787827133.357284:0:7845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:2.0:1787827133.737941:0:7893:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea76a7b40 20000000:00000080:2.0:1787827133.737958:0:7893:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8bbd18a800 uarg=0000000000000000 20000000:01000000:2.0:1787827133.737998:0:7893:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787827133.738004:0:7893:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787827133.738008:0:7893:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787827133.738074:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787827133.738085:0:7893:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787827133.740636:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827133.740833:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787827133.740858:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787827133.740880:0:7893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787827133.740893:0:7893:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787827133.740906:0:7893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.740924:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.740929:0:7893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.740933:0:7893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.740961:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.740969:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 15 pid: 6478 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827133.740979:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008712dcad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874672580832512:0@lo:104: 00000100:00100000:2.0:1787827133.741043:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827133.741106:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832512 00000100:00100000:1.0:1787827133.741114:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832512 00010000:00010000:2.0:1787827133.741124:0:7893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827133.741132:0:7893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827133.741140:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874672580832640:0@lo:104: 00000100:00100000:2.0:1787827133.741168:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827133.741200:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dffea1e3 going to sleep for 11 seconds 00000100:00100000:1.0:1787827133.741333:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832640 00000100:00100000:1.0:1787827133.741337:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832640 00000100:00100000:3.0:1787827133.741402:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787827133.741411:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787827133.741416:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d9de82b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:7893:x1874672580832512:12345-0@lo:104: 00000100:00100000:0.0:1787827133.741424:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007da589c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:7893:x1874672580832640:12345-0@lo:104: 00010000:00010000:3.0:1787827133.741429:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741434:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741498:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827133.741504:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007da589c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:7893:x1874672580832640:12345-0@lo:104: Request processed in 85us (336us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827133.741507:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787827133.741517:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d9de82b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:7893:x1874672580832512:12345-0@lo:104: Request processed in 107us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827133.741522:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787827133.741541:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787827133.741546:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787827133.741551:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741558:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fbd09ed3 already unused, calling callback (00000000f4bdffda) 10000000:00010000:0.0:1787827133.741561:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.741563:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827133.741571:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741572:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787827133.741590:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.741591:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004980bcee already unused, calling callback (00000000f4bdffda) 10000000:00010000:3.0:1787827133.741595:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827133.741605:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787827133.741607:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827133.741614:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827133.741620:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787827133.741632:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741639:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787827133.741641:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.741649:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827133.741656:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741663:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000fbd09ed3/0xb2e8bd65d71dd685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd68c expref: -99 pid: 6461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.741667:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.741675:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000004980bcee/0xb2e8bd65d71dd7b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7b9 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.741676:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827133.741679:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827133.741682:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827133.741700:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827133.741703:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827133.741704:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827133.741716:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eaf30b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580832896:0@lo:103: 00000100:00100000:3.0:1787827133.741755:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827133.741798:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008712dcad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874672580832512:0@lo:104: 00000100:00100000:2.0:1787827133.741807:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000431e63b1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7893:1874672580832640:0@lo:104: 00010000:00010000:2.0:1787827133.741830:0:7893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827133.741916:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580832768:0@lo:103: 00000100:00100000:0.0:1787827133.741947:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827133.741983:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832896 00000100:00100000:0.0:1787827133.741987:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832896 00010000:00010000:0.0:1787827133.742002:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 16 pid: 6478 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827133.742020:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580832768 00000100:00100000:0.0:1787827133.742023:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580832768 00010000:00010000:0.0:1787827133.742034:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 17 pid: 6476 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827133.742051:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827133.742056:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070b51c43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3613:x1874672580832896:12345-0@lo:103: 00010000:00010000:0.0:1787827133.742065:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827133.742070:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 17 pid: 6478 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742078:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 17 pid: 6478 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742089:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071a1a6ac/0xb2e8bd65d71dd7b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7b2 expref: 17 pid: 6478 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742100:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827133.742129:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070b51c43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3613:x1874672580832896:12345-0@lo:103: Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827133.742135:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827133.742153:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787827133.742158:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f9850c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580832768:12345-0@lo:103: 00010000:00010000:0.0:1787827133.742165:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827133.742174:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827133.742179:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eaf30b21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580832896:0@lo:103: 00010000:00010000:0.0:1787827133.742184:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742196:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a924e5cc/0xb2e8bd65d71dd68c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd685 expref: 15 pid: 6476 timeout: 236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742206:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742213:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742223:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742229:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742234:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742239:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742244:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000684b145e already unused, calling callback (000000005d28ebf6) 00010000:00010000:0.0:1787827133.742246:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742251:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742280:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827133.742289:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827133.742313:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f9850c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3616:x1874672580832768:12345-0@lo:103: Request processed in 156us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827133.742319:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787827133.742344:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580832768:0@lo:103: 00010000:00010000:3.0:1787827133.742429:0:7893:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.742436:0:7893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827133.742441:0:7893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000684b145e/0xb2e8bd65d71dd7ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827133.974500:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00010000:00010000:1.0:1787827134.102544:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827134.998541:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 0 seconds 00010000:00010000:0.0:1787827135.127543:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827135.382658:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580833024:0@lo:41: 00000100:00100000:2.0:1787827135.382735:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.382788:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833024 00000100:00100000:3.0:1787827135.382796:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833024 00000100:00100000:3.0:1787827135.382850:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787827135.382870:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000431e63b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580833024:12345-0@lo:41: 00000004:00000024:3.0:1787827135.382908:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787827135.382974:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000431e63b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580833024:12345-0@lo:41: Request processed in 116us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.382981:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827135.383093:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda38ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580833024:0@lo:41: 00000100:00080000:0.0:1787827135.383289:0:2370:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787827135.383295:0:2370:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787827135.383298:0:2370:0:(import.c:65:import_set_state_nolock()) 00000000a3a9082e lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787827135.383304:0:2370:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 82 00000100:00080000:0.0:1787827135.383309:0:2370:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787827135.383312:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d6d948e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580833152:0@lo:400: 00000100:00080000:0.0:1787827135.383316:0:2370:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a3a9082e using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827135.383325:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e66b43c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580833280:0@lo:400: 00000100:00100000:0.0:1787827135.383340:0:2370:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f835cba0 x1874672580833408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827135.383366:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827135.383406:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827135.383425:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1874672580833536:0@lo:400: 00000100:00100000:2.0:1787827135.383449:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833152 00000100:00100000:3.0:1787827135.383453:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580833408:0@lo:38: 00000100:00100000:2.0:1787827135.383455:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833152 00000100:00100000:0.0:1787827135.383462:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.383486:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787827135.383493:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eec1f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3615:x1874672580833152:12345-0@lo:400: 00000100:00100000:3.0:1787827135.383509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827135.383545:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833408 00000100:00100000:2.0:1787827135.383550:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eec1f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3615:x1874672580833152:12345-0@lo:400: Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.383551:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833408 00000100:00100000:3.0:1787827135.383559:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833280 00000100:00100000:2.0:1787827135.383563:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787827135.383565:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833280 00000100:00100000:0.0:1787827135.383581:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787827135.383588:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a473d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1874672580833408:12345-0@lo:38: 00000100:00100000:3.0:1787827135.383599:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833536 00000100:00100000:3.0:1787827135.383609:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833536 00010000:00080000:0.0:1787827135.383611:0:6490:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 88 last 0 00000100:00100000:2.0:1787827135.383616:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d6d948e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580833152:0@lo:400: 00000100:00100000:1.0:1787827135.383626:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827135.383637:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010bc5120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580833280:12345-0@lo:400: 00000100:00100000:3.0:1787827135.383643:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787827135.383649:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:0.0:1787827135.383650:0:6490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71dd7f1 00000100:00100000:2.0:1787827135.383659:0:6486:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787827135.383673:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000004:00100000:0.0:1787827135.383677:0:6490:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787827135.383682:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ecba8d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1874672580833536:12345-0@lo:400: 00000001:00000004:0.0:1787827135.383684:0:6490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787827135.383694:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010bc5120 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580833280:12345-0@lo:400: Request processed in 60us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827135.383712:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827135.383727:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ecba8d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1874672580833536:12345-0@lo:400: Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827135.383736:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787827135.383754:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006e66b43c x1874672580833280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827135.383766:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e66b43c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580833280:0@lo:400: 00010000:00080000:0.0:1787827135.383791:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f8d7b733 x1874672580833536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827135.383803:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1874672580833536:0@lo:400: 00000100:00080000:0.0:1787827135.387299:0:6490:0:(import.c:65:import_set_state_nolock()) 00000000dcf663da : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827135.387422:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a473d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3612:x1874672580833408:12345-0@lo:38: Request processed in 3833us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827135.387431:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787827135.387437:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787827135.387447:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787827135.387456:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787827135.387461:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787827135.387463:0:3612:0:(import.c:65:import_set_state_nolock()) 00000000a3a9082e lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787827135.387484:0:3612:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000895b3cbf): req@000000000f2ef0a2 x1874672580828416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827135.387501:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f835cba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580833408:0@lo:38: 00000100:00100000:1.0:1787827135.387844:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580833664:0@lo:41: 00000100:00100000:1.0:1787827135.387909:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.387957:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833664 00000100:00100000:3.0:1787827135.387963:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833664 00000100:00100000:3.0:1787827135.388008:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787827135.388016:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba14b17d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1874672580833664:12345-0@lo:41: 00000004:00000024:3.0:1787827135.388038:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1787827135.388061:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.388092:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895b3cbf going to sleep for 11 seconds 00000100:00100000:0.0:1787827135.388097:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580828416 00000100:00100000:0.0:1787827135.388103:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580828416 00000100:00100000:3.0:1787827135.388107:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba14b17d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3614:x1874672580833664:12345-0@lo:41: Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.388115:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787827135.388138:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787827135.388144:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8d7b733 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580833664:0@lo:41: 00000100:00100000:3.0:1787827135.388149:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008712dcad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580828416:12345-0@lo:1000: 00000100:00100000:3.0:1787827135.388215:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008712dcad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580828416:12345-0@lo:1000: Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.388222:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787827135.388315:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f2ef0a2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580828416:0@lo:1000: 00000040:01000000:2.0:1787827135.388343:0:7432:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787827135.388372:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580833792:0@lo:1000: 00000100:00100000:2.0:1787827135.388424:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.388444:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 000000008416d679 going to sleep for 11 seconds 00000100:00100000:1.0:1787827135.388465:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833792 00000100:00100000:1.0:1787827135.388470:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833792 00000100:00100000:1.0:1787827135.388502:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787827135.388508:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2f8f487 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580833792:12345-0@lo:1000: 00000100:00100000:1.0:1787827135.388614:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2f8f487 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580833792:12345-0@lo:1000: Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827135.388620:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787827135.388626:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580833792:0@lo:1000: 00000100:00100000:2.0:1787827135.388667:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580833920:0@lo:700: 00000100:00100000:2.0:1787827135.388700:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.388716:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000649b6ae0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827135.388750:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580833920 00000100:00100000:3.0:1787827135.388755:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580833920 00000100:00100000:3.0:1787827135.388791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787827135.388970:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206ec1e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580833920:12345-0@lo:700: 00000100:00100000:3.0:1787827135.389022:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206ec1e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580833920:12345-0@lo:700: Request processed in 226us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.389085:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827135.389246:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580833920:0@lo:700: 00000100:00100000:2.0:1787827135.389344:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834048:0@lo:1000: 00000100:00100000:2.0:1787827135.389400:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.389416:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df467dd3 going to sleep for 11 seconds 00000100:00100000:3.0:1787827135.389571:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834048 00000100:00100000:3.0:1787827135.389577:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834048 00000100:00100000:3.0:1787827135.389610:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787827135.389617:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7198c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580834048:12345-0@lo:1000: 00000100:00100000:3.0:1787827135.389702:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7198c17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580834048:12345-0@lo:1000: Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.389708:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787827135.389764:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834048:0@lo:1000: 00000004:00080000:2.0:1787827135.389803:0:7432:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000649b6ae0 with version 0 00000020:00100000:2.0:1787827135.389818:0:7432:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787827135.389823:0:7432:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003f09302e x1874672580834304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787827135.389835:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834304:0@lo:1000: 00000100:00100000:2.0:1787827135.389871:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.389893:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc2e45b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787827135.389933:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834304 00000100:00100000:0.0:1787827135.389938:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834304 00000100:00100000:0.0:1787827135.389974:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787827135.389981:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000854b1af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7432:x1874672580834304:12345-0@lo:1000: 00000001:00080000:3.0:1787827135.391808:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1787827135.391819:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787827135.391947:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000854b1af6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7432:x1874672580834304:12345-0@lo:1000: Request processed in 1966us (2075us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787827135.391958:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787827135.391986:0:7432:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787827135.391997:0:7432:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787827135.392011:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834304:0@lo:1000: 00000100:00100000:2.0:1787827135.392081:0:7432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834432:0@lo:1000: 00000100:00100000:2.0:1787827135.392134:0:7432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827135.392172:0:7432:0:(client.c:2715:ptlrpc_set_wait()) set 00000000880ad003 going to sleep for 11 seconds 00000100:00100000:3.0:1787827135.392181:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834432 00000100:00100000:3.0:1787827135.392194:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834432 00000100:00100000:3.0:1787827135.392229:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787827135.392237:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b4e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7432:x1874672580834432:12345-0@lo:1000: 00000100:00100000:3.0:1787827135.392305:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b4e198 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7432:x1874672580834432:12345-0@lo:1000: Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827135.392322:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787827135.392329:0:7432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f09302e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7432:1874672580834432:0@lo:1000: 00000040:00080000:2.0:1787827135.392347:0:7432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1787827135.392372:0:7432:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000cc2e45b9 with version 1 00000004:00080000:3.0:1787827135.392424:0:7430:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d3cd4a0a version 1 rpc_version 1 00000020:00100000:3.0:1787827135.392451:0:7430:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787827135.392457:0:7430:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cf19da25 x1874672580834688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787827135.392472:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf19da25 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7430:1874672580834688:0@lo:1000: 00000100:00100000:3.0:1787827135.392522:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827135.392544:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d88992b4 going to sleep for 11 seconds 00000100:00100000:0.0:1787827135.392573:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834688 00000100:00100000:0.0:1787827135.392577:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834688 00000100:00100000:0.0:1787827135.392600:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827135.392604:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e60a3244 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7430:x1874672580834688:12345-0@lo:1000: 00000001:00080000:3.0:1787827135.393337:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1787827135.393445:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e60a3244 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7430:x1874672580834688:12345-0@lo:1000: Request processed in 839us (922us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787827135.393455:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1787827135.393472:0:7430:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787827135.393476:0:7430:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787827135.393492:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf19da25 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7430:1874672580834688:0@lo:1000: 00000040:00080000:2.0:1787827135.394413:0:7432:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787827135.394474:0:7432:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 6, retries 0 00000004:00080000:2.0:1787827135.394478:0:7432:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787827136.150647:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787827136.214488:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787827136.214494:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8bba965800 from 4 10000000:01000000:0.0:1787827136.214505:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787827136.214557:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.214568:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.214577:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827136.214599:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580834816:0@lo:101: 00000100:00100000:0.0:1787827136.214677:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827136.214726:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b257eb2 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.214738:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834816 00000100:00100000:3.0:1787827136.214747:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834816 00000100:00100000:3.0:1787827136.214818:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787827136.214829:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007733ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580834816:12345-0@lo:101: 00010000:00010000:3.0:1787827136.214842:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827136.214869:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004980bcee/0xb2e8bd65d71dd7ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd7f8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.214902:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004980bcee/0xb2e8bd65d71dd7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.214913:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004980bcee/0xb2e8bd65d71dd7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.214921:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004980bcee, rc 0) 00000100:00100000:3.0:1787827136.215010:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007733ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580834816:12345-0@lo:101: Request processed in 184us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.215018:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787827136.215175:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580834816:0@lo:101: 00010000:00010000:0.0:1787827136.215189:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.215196:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827136.215243:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580834944:0@lo:256: 00000100:00100000:0.0:1787827136.215275:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827136.215299:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 000000006b257eb2 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.215325:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580834944 00000100:00100000:3.0:1787827136.215330:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580834944 00000100:00100000:3.0:1787827136.215362:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787827136.215371:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000066e2ecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580834944:12345-0@lo:256: 20000000:01000000:3.0:1787827136.215418:0:7426:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787827136.215434:0:7426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787827136.215437:0:7426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787827136.215530:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000066e2ecc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580834944:12345-0@lo:256: Request processed in 160us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827136.215541:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580834944:0@lo:256: 00000100:00100000:3.0:1787827136.215548:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 10000000:01000000:0.0:1787827136.215593:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787827136.215599:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.215605:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000cb7a4916/0xb2e8bd65d71dd7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827136.215617:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787827136.215620:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8bba965800 from 1 10000000:01000000:0.0:1787827136.215622:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787827136.215636:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000b9d517f5/0xb2e8bd65d71dd806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.215642:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000b9d517f5/0xb2e8bd65d71dd806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827136.215647:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000b9d517f5/0xb2e8bd65d71dd806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827136.215656:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835072:0@lo:101: 00000100:00100000:0.0:1787827136.215681:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827136.215712:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011797bc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.215726:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835072 00000100:00100000:3.0:1787827136.215731:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835072 00000100:00100000:3.0:1787827136.215761:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787827136.215769:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3bbc0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580835072:12345-0@lo:101: 00010000:00010000:3.0:1787827136.215777:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827136.215786:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000867e1aef/0xb2e8bd65d71dd80d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd806 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.215801:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000867e1aef/0xb2e8bd65d71dd80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.215810:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000867e1aef/0xb2e8bd65d71dd80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.215817:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000867e1aef, rc 0) 00000100:00100000:3.0:1787827136.215865:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3bbc0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835072:12345-0@lo:101: Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.215871:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787827136.215912:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ddf8508 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835072:0@lo:101: 00010000:00010000:2.0:1787827136.215925:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000b9d517f5/0xb2e8bd65d71dd806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.215933:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000b9d517f5/0xb2e8bd65d71dd806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827136.215981:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835200:0@lo:501: 00000100:00100000:2.0:1787827136.216007:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827136.216026:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3c33a36 going to sleep for 11 seconds 00000100:00100000:0.0:1787827136.216040:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835200 00000100:00100000:0.0:1787827136.216046:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835200 00000100:00100000:3.0:1787827136.216138:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787827136.216147:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000896765ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835200:12345-0@lo:501: 00000100:00100000:3.0:1787827136.216255:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000896765ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835200:12345-0@lo:501: Request processed in 110us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.216262:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787827136.216372:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835200:0@lo:501: 00000100:00100000:2.0:1787827136.216446:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835328:0@lo:503: 00000100:00100000:2.0:1787827136.216629:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.216667:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835328 00000100:00100000:2.0:1787827136.216672:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3c33a36 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.216673:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835328 00000100:00100000:3.0:1787827136.216711:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787827136.216729:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055cfe37f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835328:12345-0@lo:503: 00000100:00100000:3.0:1787827136.216816:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055cfe37f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835328:12345-0@lo:503: Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.216823:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787827136.216833:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835328:0@lo:503: 00000100:00100000:2.0:1787827136.217186:0:8257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8257:1874672580835456:0@lo:502: 00000100:00100000:2.0:1787827136.217225:0:8257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827136.217246:0:8257:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086376d71 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.217252:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835456 00000100:00100000:3.0:1787827136.217258:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835456 00000100:00100000:3.0:1787827136.217285:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787827136.217292:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062fe1eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8257:x1874672580835456:12345-0@lo:502: 00000100:00100000:3.0:1787827136.217355:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062fe1eb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8257:x1874672580835456:12345-0@lo:502: Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.217361:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787827136.217370:0:8257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b2fa94d pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8257:1874672580835456:0@lo:502: 00000020:01000000:2.0:1787827136.217884:0:8257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827136.217895:0:8257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827136.217897:0:8257:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787827136.217906:0:8257:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8bba965800 00000020:00000080:2.0:1787827136.217909:0:8257:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787827136.217948:0:8257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8257:1874672580835584:0@lo:502: 00000100:00100000:2.0:1787827136.217995:0:8257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827136.218039:0:8257:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.219048:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835584 00000100:00100000:3.0:1787827136.219055:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835584 00000100:00100000:3.0:1787827136.219103:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787827136.219113:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8257:x1874672580835584:12345-0@lo:502: 00000100:00100000:3.0:1787827136.219221:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8257:x1874672580835584:12345-0@lo:502: Request processed in 110us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.219229:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787827136.219321:0:8257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8257:1874672580835584:0@lo:502: 00000020:01000000:2.0:1787827136.219351:0:8257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827136.219358:0:8257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827136.219360:0:8257:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787827136.219365:0:8257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787827136.219588:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787827136.219625:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827136.219635:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.219655:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827136.219665:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787827136.219668:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8b98781000 from 4 10000000:01000000:3.0:1787827136.219671:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787827136.219714:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.219723:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.219732:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827136.219753:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835712:0@lo:101: 00000100:00100000:3.0:1787827136.219786:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.219819:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827136.219990:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835712 00000100:00100000:2.0:1787827136.219996:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835712 00000100:00100000:2.0:1787827136.220029:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787827136.220037:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580835712:12345-0@lo:101: 00010000:00010000:2.0:1787827136.220057:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827136.220071:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd814 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.220092:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.220116:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.220125:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bb5f0a800, rc 0) 00000100:00100000:2.0:1787827136.220171:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580835712:12345-0@lo:101: Request processed in 134us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827136.220179:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787827136.220223:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835712:0@lo:101: 00010000:00010000:3.0:1787827136.220240:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.220251:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827136.220883:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835840:0@lo:256: 00000100:00100000:3.0:1787827136.220924:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.220958:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.220976:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835840 00000100:00100000:3.0:1787827136.220979:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835840 00000100:00100000:3.0:1787827136.221013:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787827136.221026:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580835840:12345-0@lo:256: 20000000:01000000:3.0:1787827136.221041:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787827136.221056:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787827136.221060:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787827136.221159:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580835840:12345-0@lo:256: Request processed in 135us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.221167:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787827136.221194:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835840:0@lo:256: 10000000:01000000:2.0:1787827136.221249:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787827136.221257:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.221266:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827136.221274:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787827136.221276:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8b98781000 from 1 10000000:01000000:2.0:1787827136.221279:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787827136.221298:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.221305:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.221314:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827136.221340:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835968:0@lo:101: 00000100:00100000:2.0:1787827136.221466:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.221615:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580835968 00000100:00100000:3.0:1787827136.221620:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580835968 00000100:00100000:2.0:1787827136.221621:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.221664:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787827136.221675:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580835968:12345-0@lo:101: 00010000:00010000:3.0:1787827136.221683:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827136.221705:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd822 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.221724:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.221734:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.221742:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9c00, rc 0) 00000100:00100000:3.0:1787827136.221784:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580835968:12345-0@lo:101: Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.221790:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787827136.221816:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580835968:0@lo:101: 00010000:00010000:2.0:1787827136.221832:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827136.221841:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827136.221916:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580836096:0@lo:501: 00000100:00100000:2.0:1787827136.221948:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827136.221970:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.222022:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836096 00000100:00100000:3.0:1787827136.222027:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836096 00000100:00100000:3.0:1787827136.222069:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787827136.222078:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580836096:12345-0@lo:501: 00000100:00100000:3.0:1787827136.222184:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580836096:12345-0@lo:501: Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.222206:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787827136.222259:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580836096:0@lo:501: 00000100:00100000:3.0:1787827136.223077:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580836224:0@lo:503: 00000100:00100000:3.0:1787827136.223113:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.223136:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.223159:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836224 00000100:00100000:3.0:1787827136.223163:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836224 00000100:00100000:3.0:1787827136.223208:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787827136.223216:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580836224:12345-0@lo:503: 00000100:00100000:3.0:1787827136.223305:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580836224:12345-0@lo:503: Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.223312:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787827136.223352:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580836224:0@lo:503: 00000100:00100000:3.0:1787827136.223755:0:8258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8258:1874672580836352:0@lo:502: 00000100:00100000:3.0:1787827136.223788:0:8258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.223807:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836352 00000100:00100000:3.0:1787827136.223811:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836352 00000100:00100000:3.0:1787827136.223834:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787827136.223841:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:8258:x1874672580836352:12345-0@lo:502: 00000100:00100000:3.0:1787827136.223927:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:8258:x1874672580836352:12345-0@lo:502: Request processed in 87us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.223934:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787827136.223969:0:8258:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.223980:0:8258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8258:1874672580836352:0@lo:502: 00000020:01000000:3.0:1787827136.223998:0:8258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827136.224006:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827136.224008:0:8258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787827136.224016:0:8258:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b98781000 00000020:00000080:3.0:1787827136.224024:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787827136.224048:0:8258:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8258:1874672580836480:0@lo:502: 00000100:00100000:3.0:1787827136.224077:0:8258:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827136.224094:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836480 00000100:00100000:3.0:1787827136.224098:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836480 00000100:00100000:3.0:1787827136.224119:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787827136.224125:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:8258:x1874672580836480:12345-0@lo:502: 00000100:00100000:3.0:1787827136.224197:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:8258:x1874672580836480:12345-0@lo:502: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827136.224204:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787827136.224231:0:8258:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827136.224241:0:8258:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:8258:1874672580836480:0@lo:502: 00000020:01000000:3.0:1787827136.224259:0:8258:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827136.224263:0:8258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827136.224264:0:8258:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787827136.224268:0:8258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787827136.225109:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787827136.225138:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827136.225152:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827136.225162:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787827137.163269:0:8394:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787827137.163274:0:8394:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787827137.163275:0:8394:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787827137.163456:0:8394:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8bb88cb000 00000020:01000004:2.0:1787827137.163475:0:8394:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787827137.163489:0:8394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787827137.163507:0:8394:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f8bba7db370) 00000020:00000080:2.0:1787827137.163527:0:8394:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1787827137.175470:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787827137.180547:0:8394:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787827137.180599:0:8394:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1787827137.191186:0:8394:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787827137.191503:0:8394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787827137.191514:0:8394:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787827137.191525:0:8394:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb2e8bd65d71dd837 00000020:01000004:0.0:1787827137.191532:0:8394:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787827137.191552:0:8394:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787827137.191556:0:8394:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787827137.191561:0:8394:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787827137.191566:0:8394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787827137.191577:0:8394:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f8bbac78000) 00000020:00000080:0.0:1787827137.191589:0:8394:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1787827137.192935:0:8394:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787827137.193290:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787827137.193297:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787827137.194996:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787827137.195007:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787827137.195360:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787827137.195369:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787827137.197085:0:8394:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787827137.197267:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787827137.197274:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787827137.198093:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787827137.198102:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787827137.211325:0:8394:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787827137.211592:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787827137.211599:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787827137.212673:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787827137.212682:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787827137.214169:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787827137.214180:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787827137.216124:0:8394:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787827137.216287:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787827137.216293:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787827137.216797:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787827137.216804:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787827137.313705:0:8394:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787827137.313887:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787827137.313892:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787827137.314767:0:8394:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787827137.314774:0:8394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787827137.315026:0:8394:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787827137.315054:0:8394:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787827137.315059:0:8394:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787827137.325176:0:8394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787827137.325213:0:8394:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787827137.325217:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787827137.325219:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827137.325220:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827137.325222:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827137.325223:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827137.325224:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827137.325226:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827137.325227:0:8394:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827137.325229:0:8394:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827137.325230:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827137.325232:0:8394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827137.325235:0:8394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787827137.325237:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787827137.325239:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787827137.325240:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827137.325241:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827137.325242:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827137.325243:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827137.325245:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827137.325246:0:8394:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827137.325250:0:8394:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827137.325251:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827137.325252:0:8394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827137.325286:0:8394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787827137.325303:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580836608:0@lo:253: 00000100:00100000:0.0:1787827137.325369:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.325439:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.325604:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836608 00000100:00100000:3.0:1787827137.325635:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836608 00000100:00100000:3.0:1787827137.325708:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787827137.325716:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:8394:x1874672580836608:12345-0@lo:253: 20000000:01000000:3.0:1787827137.325752:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787827137.325756:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787827137.325761:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787827137.325765:0:6479:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787827137.326029:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787827137.326178:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787827137.326191:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787827137.326209:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787827137.326215:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787827137.326228:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787827137.326259:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787827137.326350:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787827137.326364:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:3.0:1787827137.326366:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1787827137.326375:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787827137.326395:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787827137.326409:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787827137.326415:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1787827137.326428:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787827137.326433:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787827137.326441:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787827137.326453:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787827137.326531:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1787827137.326543:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:3.0:1787827137.326545:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1787827137.326560:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1787827137.326566:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787827137.326579:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1787827137.326589:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1787827137.326600:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1787827137.326603:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787827137.326610:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1787827137.326618:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1787827137.326953:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1787827137.326965:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:3.0:1787827137.326966:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1787827137.326976:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1787827137.326981:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787827137.326993:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1787827137.326998:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1787827137.327010:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1787827137.327016:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787827137.327029:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1787827137.327044:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1787827137.327053:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787827137.327055:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787827137.327059:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787827137.327106:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787827137.327109:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787827137.327527:0:8413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787827137.327720:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787827137.327751:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787827137.327767:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787827137.327778:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787827137.327780:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787827137.328159:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787827137.328182:0:8414:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787827137.328198:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787827137.328338:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787827137.328359:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787827137.328371:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787827137.328413:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787827137.328415:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787827137.328671:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787827137.328692:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787827137.328708:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787827137.328803:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1787827137.328825:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1787827137.328838:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1787827137.328861:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787827137.328863:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787827137.329112:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787827137.329129:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787827137.329139:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1787827137.329194:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1787827137.329212:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1787827137.329227:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1787827137.329241:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787827137.329264:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329285:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329293:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 18 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329300:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329307:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329314:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329323:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329366:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329397:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 18 pid: 6476 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.329410:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836736:0@lo:104: 00000100:00100000:3.0:1787827137.329481:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.329516:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836736 00000100:00100000:0.0:1787827137.329524:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836736 00010000:00010000:3.0:1787827137.329546:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329557:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.329566:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836864:0@lo:104: 00000100:00100000:0.0:1787827137.329592:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787827137.329598:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.329609:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6479:x1874672580836736:12345-0@lo:104: 00010000:00010000:0.0:1787827137.329628:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.329628:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836864 00000100:00100000:2.0:1787827137.329635:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836864 00010000:00010000:3.0:1787827137.329640:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329651:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.329661:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b91775680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836992:0@lo:104: 00000100:00100000:2.0:1787827137.329667:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787827137.329677:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580836864:12345-0@lo:104: 00010000:00010000:2.0:1787827137.329686:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.329715:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787827137.329725:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.329727:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580836736:12345-0@lo:104: Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.329750:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787827137.329758:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787827137.329763:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580836992 00000100:00100000:2.0:1787827137.329768:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6479:x1874672580836864:12345-0@lo:104: Request processed in 91us (170us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827137.329772:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 18 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.329775:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580836992 00010000:00010000:0.0:1787827137.329783:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1787827137.329787:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787827137.329795:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329798:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 18 pid: 7426 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.329815:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa9200 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:0.0:1787827137.329820:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.329821:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a857103c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580837120:0@lo:104: 00010000:00010000:2.0:1787827137.329837:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787827137.329839:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.329858:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.329863:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 10000000:00010000:0.0:1787827137.329867:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.329879:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827137.329890:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5ce00 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:1.0:1787827137.329891:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6479:x1874672580836992:12345-0@lo:104: 10000000:01000000:0.0:1787827137.329902:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1787827137.329902:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329914:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.329921:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.329922:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.329927:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827137.329933:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.329944:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827137.329978:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787827137.329985:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787827137.329997:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580837248:0@lo:104: 00010000:00010000:2.0:1787827137.330002:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.330010:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827137.330013:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.330019:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330025:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9200/0xb2e8bd65d71dd7c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7c7 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.330031:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71dd77a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd781 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330043:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827137.330046:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827137.330047:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827137.330057:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827137.330064:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.330067:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:2.0:1787827137.330069:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827137.330069:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bba993180 going to sleep for 11 seconds 00010000:00010000:0.0:1787827137.330070:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.330074:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827137.330087:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6479:x1874672580836992:12345-0@lo:104: Request processed in 201us (361us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827137.330092:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80030a00 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:2.0:1787827137.330098:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580837376:0@lo:103: 00000100:00100000:3.0:1787827137.330098:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836736:0@lo:104: 10000000:00010000:0.0:1787827137.330100:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.330102:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787827137.330121:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330126:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836864:0@lo:104: 10000000:00010000:0.0:1787827137.330128:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827137.330133:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787827137.330143:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b91775680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580836992:0@lo:104: 00000100:00100000:1.0:1787827137.330157:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837120 00010000:00010000:0.0:1787827137.330163:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.330164:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837120 00000100:00100000:2.0:1787827137.330165:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827137.330177:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787827137.330177:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837248 00000100:00100000:3.0:1787827137.330182:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837248 00010000:00010000:0.0:1787827137.330206:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.330213:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787827137.330224:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd71f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd72d expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.330235:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85711a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580837120:12345-0@lo:104: 00000100:00100000:3.0:1787827137.330237:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1787827137.330256:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.330257:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330258:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbab50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580837248:12345-0@lo:104: 00010000:00010000:0.0:1787827137.330260:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827137.330266:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827137.330284:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.330336:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827137.330343:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a857103c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580837120:0@lo:104: 00000100:00100000:1.0:1787827137.330347:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85711a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580837120:12345-0@lo:104: Request processed in 120us (476us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827137.330358:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787827137.330362:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6479:1874672580837248:0@lo:104: 00000100:00100000:1.0:1787827137.330365:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787827137.330375:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbab50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6479:x1874672580837248:12345-0@lo:104: Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.330411:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787827137.330454:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837376 00000100:00100000:2.0:1787827137.330456:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827137.330459:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837376 00000100:00100000:2.0:1787827137.330475:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580837504:0@lo:103: 00010000:00010000:0.0:1787827137.330481:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.330487:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 19 pid: 6476 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.330518:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787827137.330525:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330525:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787827137.330541:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5e3b200 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:3.0:1787827137.330548:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:3615:x1874672580837376:12345-0@lo:103: 00000100:00100000:2.0:1787827137.330549:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787827137.330550:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.330573:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.330575:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827137.330589:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 19 pid: 6476 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827137.330590:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.330592:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837504 00000100:00100000:0.0:1787827137.330600:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837504 00000100:00100000:2.0:1787827137.330621:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787827137.330632:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 20 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.330632:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 20 pid: 6476 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827137.330634:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787827137.330641:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580837632:0@lo:103: 00010000:00010000:1.0:1787827137.330682:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.330685:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5d600/0xb2e8bd65d71dd7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7c0 expref: 20 pid: 6476 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.330699:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787827137.330712:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827137.330716:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787827137.330725:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:3615:x1874672580837504:12345-0@lo:103: 00010000:00010000:1.0:1787827137.330735:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330739:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827137.330740:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827137.330751:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 19 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.330757:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580837760:0@lo:103: 00010000:00010000:1.0:1787827137.330758:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5e3b200/0xb2e8bd65d71dd718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd726 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330789:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 19 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.330795:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787827137.330802:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:3615:x1874672580837376:12345-0@lo:103: Request processed in 262us (634us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827137.330805:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330813:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd77a expref: 19 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330831:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827137.330832:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827137.330858:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031200 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:1.0:1787827137.330864:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.330871:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827137.330874:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330876:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837632 00000100:00100000:3.0:1787827137.330883:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837632 10000000:00010000:1.0:1787827137.330888:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827137.330896:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787827137.330905:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837760 00010000:00010000:3.0:1787827137.330907:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.330910:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837760 00000100:00100000:0.0:1787827137.330924:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:3615:x1874672580837504:12345-0@lo:103: Request processed in 202us (383us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827137.330925:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.330937:0:7425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 19 pid: 7426 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.330944:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787827137.330960:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787827137.330964:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787827137.330967:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:3614:x1874672580837632:12345-0@lo:103: 00010000:00010000:3.0:1787827137.330983:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827137.330985:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.330992:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.330993:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787827137.331017:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd6d9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.331020:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3614:x1874672580837760:12345-0@lo:103: 00010000:00010000:3.0:1787827137.331040:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.331043:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827137.331046:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.331052:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.331056:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827137.331060:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 18 pid: 7426 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.331064:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787827137.331072:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd71f expref: 18 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.331073:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 18 pid: 7426 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.331078:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580837888:0@lo:103: 00010000:00010000:3.0:1787827137.331123:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787827137.331129:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827137.331132:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5d800/0xb2e8bd65d71dd726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd718 expref: 17 pid: 7426 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.331159:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827137.331169:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1787827137.331182:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1787827137.331184:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827137.331184:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3614:x1874672580837632:12345-0@lo:103: Request processed in 219us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.331200:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787827137.331217:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3614:x1874672580837760:12345-0@lo:103: Request processed in 207us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.331225:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580837888 00000100:00100000:2.0:1787827137.331229:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787827137.331234:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580837888 00010000:00010000:3.0:1787827137.331259:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 15 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.331277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580837504:0@lo:103: 00000100:00100000:3.0:1787827137.331298:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787827137.331301:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580837376:0@lo:103: 00000100:00100000:3.0:1787827137.331311:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb888d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580837888:12345-0@lo:103: 00010000:00010000:3.0:1787827137.331322:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827137.331327:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 15 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.331332:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827137.331345:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 15 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331362:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5d200/0xb2e8bd65d71dd6d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd6d2 expref: 15 pid: 6478 timeout: 239 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.331368:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580837760:0@lo:103: 00010000:00010000:3.0:1787827137.331396:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331405:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331418:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331423:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331428:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.331434:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580837632:0@lo:103: 00010000:00010000:3.0:1787827137.331449:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331457:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa9e00 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:3.0:1787827137.331461:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331469:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331489:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.331502:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.331504:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827137.331514:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.331522:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71dd845 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787827137.331539:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787827137.331558:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb888d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3616:x1874672580837888:12345-0@lo:103: Request processed in 250us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.331571:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787827137.331612:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580837888:0@lo:103: 00000100:00100000:0.0:1787827137.332985:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:8394:x1874672580836608:12345-0@lo:253: Request processed in 7265us (7612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.332997:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787827137.333033:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580836608:0@lo:253: 10000000:01000000:2.0:1787827137.333045:0:8394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787827137.333047:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787827137.333049:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787827137.333050:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827137.333052:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787827137.333053:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827137.333055:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827137.333056:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787827137.333058:0:8394:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787827137.333059:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827137.333061:0:8394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787827137.333079:0:8394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8bb88cb000 from lustre-OST0000 10000000:01000000:2.0:1787827137.333120:0:8394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787827137.333123:0:8394:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787827137.333130:0:8394:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b988b19b8 local copy 10000000:01000000:2.0:1787827137.333134:0:8394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787827137.333160:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.333167:0:8394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.333183:0:8394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.333195:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838016:0@lo:101: 00000100:00100000:2.0:1787827137.333228:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.333272:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613480 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.333282:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838016 00000100:00100000:3.0:1787827137.333289:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838016 00000100:00100000:3.0:1787827137.333329:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787827137.333338:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:8394:x1874672580838016:12345-0@lo:101: 00010000:00010000:3.0:1787827137.333350:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827137.333362:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8600/0xb2e8bd65d71dd853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd84c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.333407:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8600/0xb2e8bd65d71dd853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd84c expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.333420:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8600/0xb2e8bd65d71dd853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd84c expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.333435:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8600, rc 0) 00000100:00100000:3.0:1787827137.333485:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838016:12345-0@lo:101: Request processed in 148us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.333492:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787827137.333532:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838016:0@lo:101: 00010000:00010000:0.0:1787827137.333547:0:8394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333563:0:8394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.333656:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838144:0@lo:501: 00000100:00100000:0.0:1787827137.333684:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.333712:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.333728:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838144 00000100:00100000:3.0:1787827137.333732:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838144 00000100:00100000:3.0:1787827137.333755:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787827137.333761:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838144:12345-0@lo:501: 00000100:00100000:3.0:1787827137.333811:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838144:12345-0@lo:501: Request processed in 50us (125us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787827137.333817:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787827137.333825:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838144:0@lo:501: 10000000:01000000:0.0:1787827137.333840:0:8394:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787827137.333871:0:8394:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787827137.333876:0:8394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333884:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333891:0:8394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333909:0:8394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787827137.333928:0:8394:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8bb88cb000 10000000:01000000:0.0:1787827137.333932:0:8394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787827137.333935:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1787827137.333937:0:8394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787827137.333941:0:8394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787827137.333942:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827137.333947:0:8394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787827137.333953:0:8394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787827137.333953:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5f0b800 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:1.0:1787827137.333958:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.333967:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333970:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.333995:0:8394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827137.333996:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.334013:0:8394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827137.334013:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827137.334029:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838272:0@lo:101: 00010000:00010000:1.0:1787827137.334033:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.334039:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827137.334056:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.334057:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827137.334067:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd853 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.334079:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838272 00000100:00100000:0.0:1787827137.334082:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787827137.334083:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827137.334083:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827137.334085:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838272 00010000:00010000:1.0:1787827137.334088:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.334093:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827137.334099:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580838400:0@lo:103: 00000100:00100000:2.0:1787827137.334123:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787827137.334136:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838272:12345-0@lo:101: 00000100:00100000:3.0:1787827137.334136:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827137.334145:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827137.334154:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd85a expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.334163:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838400 00000100:00100000:0.0:1787827137.334168:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838400 00010000:00010000:2.0:1787827137.334170:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 15 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.334179:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.334186:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bb5f0a200, rc 0) 00000100:00100000:0.0:1787827137.334208:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787827137.334218:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85712940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3615:x1874672580838400:12345-0@lo:103: 00000100:00100000:2.0:1787827137.334223:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580838272:12345-0@lo:101: Request processed in 88us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.334230:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787827137.334231:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787827137.334237:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838272:0@lo:101: 00010000:00010000:0.0:1787827137.334246:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8600/0xb2e8bd65d71dd853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb2e8bd65d71dd84c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.334251:0:8394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.334258:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827137.334261:0:8394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.334296:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85712940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3615:x1874672580838400:12345-0@lo:103: Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.334304:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827137.334323:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580838400:0@lo:103: 00000100:00100000:3.0:1787827137.334324:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838528:0@lo:501: 00000100:00100000:3.0:1787827137.334357:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.334374:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.334438:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838528 00000100:00100000:0.0:1787827137.334443:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838528 00000100:00100000:0.0:1787827137.334467:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787827137.334475:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838528:12345-0@lo:501: 00000100:00100000:0.0:1787827137.334552:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838528:12345-0@lo:501: Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.334568:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787827137.334575:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838528:0@lo:501: 00000100:00100000:3.0:1787827137.334622:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838656:0@lo:503: 00000100:00100000:3.0:1787827137.334658:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.334681:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.334687:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838656 00000100:00100000:0.0:1787827137.334692:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838656 00000100:00100000:0.0:1787827137.334721:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787827137.334727:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838656:12345-0@lo:503: 00000100:00100000:0.0:1787827137.334803:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838656:12345-0@lo:503: Request processed in 76us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.334810:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787827137.334865:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838656:0@lo:503: 00000040:00080000:3.0:1787827137.335098:0:8394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827137.335169:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838784:0@lo:502: 00000100:00100000:3.0:1787827137.335210:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.335237:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.335303:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838784 00000100:00100000:0.0:1787827137.335307:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838784 00000100:00100000:0.0:1787827137.335334:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787827137.335338:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838784:12345-0@lo:502: 00000100:00100000:0.0:1787827137.335420:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838784:12345-0@lo:502: Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.335426:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787827137.335463:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838784:0@lo:502: 00000040:00080000:3.0:1787827137.335647:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787827137.335671:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787827137.335685:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787827137.335697:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787827137.335709:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787827137.335722:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787827137.335741:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838912:0@lo:502: 00000100:00100000:3.0:1787827137.335774:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.335802:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.335840:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580838912 00000100:00100000:0.0:1787827137.335858:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580838912 00000100:00100000:0.0:1787827137.335886:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787827137.335892:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838912:12345-0@lo:502: 00000100:00100000:0.0:1787827137.335963:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580838912:12345-0@lo:502: Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.335971:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787827137.335996:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580838912:0@lo:502: 00000040:00080000:3.0:1787827137.336037:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787827137.336045:0:8394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787827137.336680:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787827137.336688:0:8418:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1787827137.336702:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827137.336704:0:8418:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787827137.336711:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787827137.336722:0:8418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f8bbcd83370) 00000020:00000080:1.0:1787827137.336737:0:8418:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787827137.336742:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787827137.336812:0:8418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8bb88cb000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787827137.336819:0:8418:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787827137.336823:0:8418:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb2e8bd65d71dd86f 00010000:00010000:1.0:1787827137.340416:0:8418:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1787827137.340679:0:8418:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787827137.342796:0:8418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787827137.343118:0:8418:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787827137.346652:0:8418:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1787827137.346871:0:8418:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787827137.350706:0:8418:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787827137.351627:0:8418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787827137.351637:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827137.351642:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827137.351645:0:8418:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787827137.351648:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827137.351652:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827137.351654:0:8418:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787827137.351657:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787827137.351659:0:8418:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787827137.351677:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827137.351680:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827137.351682:0:8418:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787827137.351685:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787827137.351770:0:8394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787827137.351799:0:8394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787827137.351814:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.351823:0:8394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827137.351835:0:8394:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8bb88cb000 from 1 10000000:01000000:3.0:1787827137.351837:0:8394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787827137.351877:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.351883:0:8394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.351893:0:8394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.351914:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839040:0@lo:101: 00000100:00100000:3.0:1787827137.351988:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.352034:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827137.352067:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839040 00000100:00100000:1.0:1787827137.352074:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839040 00000100:00100000:1.0:1787827137.352119:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787827137.352129:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:8394:x1874672580839040:12345-0@lo:101: 00010000:00010000:1.0:1787827137.352147:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827137.352159:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd876 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.352180:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.352190:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.352198:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5c800, rc 0) 00000100:00100000:1.0:1787827137.352238:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839040:12345-0@lo:101: Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827137.352245:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787827137.352271:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839040:0@lo:101: 00010000:00010000:3.0:1787827137.352291:0:8394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.352300:0:8394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.352415:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839168:0@lo:501: 00000100:00100000:3.0:1787827137.352446:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.352476:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839168 00000100:00100000:3.0:1787827137.352476:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827137.352482:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839168 00000100:00100000:2.0:1787827137.352513:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787827137.352521:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839168:12345-0@lo:501: 00000100:00100000:2.0:1787827137.352608:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839168:12345-0@lo:501: Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.352615:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787827137.352638:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839168:0@lo:501: 00000100:00100000:3.0:1787827137.352674:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839296:0@lo:503: 00000100:00100000:3.0:1787827137.352716:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.352734:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827137.352743:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839296 00000100:00100000:2.0:1787827137.352747:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839296 00000100:00100000:2.0:1787827137.352769:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787827137.352776:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839296:12345-0@lo:503: 00000100:00100000:2.0:1787827137.352859:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839296:12345-0@lo:503: Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.352867:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787827137.352877:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839296:0@lo:503: 00000040:00080000:3.0:1787827137.353054:0:8394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827137.353106:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839424:0@lo:502: 00000100:00100000:3.0:1787827137.353138:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.353156:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.353186:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839424 00000100:00100000:0.0:1787827137.353191:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839424 00000100:00100000:0.0:1787827137.353224:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787827137.353234:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839424:12345-0@lo:502: 00000100:00100000:0.0:1787827137.353340:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839424:12345-0@lo:502: Request processed in 107us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.353349:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787827137.353362:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839424:0@lo:502: 00000040:00080000:3.0:1787827137.353550:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787827137.353571:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787827137.353587:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839552:0@lo:502: 00000100:00100000:3.0:1787827137.353621:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.353650:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b909ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827137.353697:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839552 00000100:00100000:2.0:1787827137.353702:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839552 00000100:00100000:2.0:1787827137.353751:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787827137.353757:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839552:12345-0@lo:502: 00000100:00100000:2.0:1787827137.353825:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839552:12345-0@lo:502: Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.353833:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787827137.353869:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839552:0@lo:502: 00000040:00080000:0.0:1787827137.353918:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787827137.353928:0:8394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787827137.354479:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827137.354487:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827137.354488:0:8422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787827137.354493:0:8422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8bb88cb000 00000020:00000080:3.0:1787827137.354495:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787827137.354502:0:8422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827137.354504:0:8422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827137.354505:0:8422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787827137.354508:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787827137.354565:0:8394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787827137.354591:0:8394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787827137.354607:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.354617:0:8394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827137.354662:0:8394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787827137.354665:0:8394:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8bb88cb000 10000000:01000000:2.0:1787827137.354667:0:8394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8bb88cb000 10000000:01000000:2.0:1787827137.354676:0:8394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787827137.354681:0:8394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bb88cb000 from 1 10000000:01000000:2.0:1787827137.354683:0:8394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787827137.354710:0:8394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.354717:0:8394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.354725:0:8394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.354738:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839680:0@lo:101: 00000100:00100000:2.0:1787827137.354766:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.354792:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.354856:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839680 00000100:00100000:3.0:1787827137.354862:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839680 00000100:00100000:3.0:1787827137.354890:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787827137.354899:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:8394:x1874672580839680:12345-0@lo:101: 00010000:00010000:3.0:1787827137.354908:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827137.354920:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd884 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.354946:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.354956:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.354962:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8000, rc 0) 00000100:00100000:3.0:1787827137.355000:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580839680:12345-0@lo:101: Request processed in 103us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.355008:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787827137.355025:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839680:0@lo:101: 00010000:00010000:2.0:1787827137.355037:0:8394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.355044:0:8394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.355103:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839808:0@lo:501: 00000100:00100000:2.0:1787827137.355131:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.355150:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.355157:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839808 00000100:00100000:3.0:1787827137.355160:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839808 00000100:00100000:3.0:1787827137.355185:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787827137.355190:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580839808:12345-0@lo:501: 00000100:00100000:3.0:1787827137.355257:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580839808:12345-0@lo:501: Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.355262:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787827137.355279:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839808:0@lo:501: 00000100:00100000:2.0:1787827137.355314:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839936:0@lo:503: 00000100:00100000:2.0:1787827137.355349:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.355372:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.355403:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580839936 00000100:00100000:0.0:1787827137.355408:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580839936 00000100:00100000:0.0:1787827137.355439:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787827137.355447:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580839936:12345-0@lo:503: 00000100:00100000:0.0:1787827137.355523:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580839936:12345-0@lo:503: Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.355530:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787827137.355536:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580839936:0@lo:503: 00000040:00080000:2.0:1787827137.355765:0:8394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787827137.355839:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580840064:0@lo:502: 00000100:00100000:2.0:1787827137.355891:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.355930:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.355995:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840064 00000100:00100000:3.0:1787827137.356000:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840064 00000100:00100000:3.0:1787827137.356030:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787827137.356036:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580840064:12345-0@lo:502: 00000100:00100000:3.0:1787827137.356111:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580840064:12345-0@lo:502: Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.356119:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787827137.356139:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580840064:0@lo:502: 00000040:00080000:1.0:1787827137.356276:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787827137.356302:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787827137.356319:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787827137.356335:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787827137.356356:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787827137.356374:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787827137.356439:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787827137.356458:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787827137.356472:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787827137.356485:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787827137.356499:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787827137.356524:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787827137.356539:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787827137.356550:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787827137.356557:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787827137.356571:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787827137.356578:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787827137.356584:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787827137.356590:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787827137.356597:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787827137.356603:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787827137.356609:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787827137.356616:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787827137.356628:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787827137.356641:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787827137.356653:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787827137.356666:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787827137.356684:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787827137.356691:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787827137.356698:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787827137.356704:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787827137.356711:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787827137.356717:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787827137.356724:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787827137.356730:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787827137.356736:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787827137.356743:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787827137.356756:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580840192:0@lo:502: 00000100:00100000:1.0:1787827137.356783:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827137.356803:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b887f8180 going to sleep for 11 seconds 00000100:00100000:2.0:1787827137.356815:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840192 00000100:00100000:2.0:1787827137.356819:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840192 00000100:00100000:2.0:1787827137.356851:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787827137.356858:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580840192:12345-0@lo:502: 00000100:00100000:2.0:1787827137.356939:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580840192:12345-0@lo:502: Request processed in 80us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.356947:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787827137.356954:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580840192:0@lo:502: 00000040:00080000:1.0:1787827137.356994:0:8394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787827137.357001:0:8394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787827137.357301:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787827137.357313:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f8bbcd819b8) 00000020:00000080:1.0:1787827137.357327:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787827137.357403:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8bb88cb000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827137.357406:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8bb88cb000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827137.357407:0:8423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8bb88cb000 3 00010000:00080000:1.0:1787827137.357429:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8bbaca9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787827137.359084:0:8423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787827137.359262:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787827137.359286:0:8423:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787827137.359295:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb2e8bd65d71dd899 00000100:00080000:1.0:1787827137.359301:0:8423:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827137.359305:0:8423:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f8bbaca9800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827137.359327:0:8423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b929970c0 x1874672580840320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827137.359344:0:8423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787827137.359372:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1874672580840320:0@lo:38: 00000100:00100000:3.0:1787827137.359443:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.359490:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580840448:0@lo:400: 00000100:00100000:2.0:1787827137.359533:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787827137.359541:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000100:00100000:3.0:1787827137.359543:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840320 00000100:00100000:3.0:1787827137.359548:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840320 00000020:00000080:1.0:1787827137.359556:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f8bbcd84d28) 00000100:00100000:2.0:1787827137.359557:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787827137.359566:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580840576:0@lo:400: 00000100:00100000:3.0:1787827137.359571:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840448 00000020:00000080:1.0:1787827137.359572:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00100000:3.0:1787827137.359574:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840448 00000100:00100000:3.0:1787827137.359603:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787827137.359608:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.359620:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580840448:12345-0@lo:400: 00000020:01000004:1.0:1787827137.359648:0:8423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8bb88cb000 from lustre-OST0000, refs=3 00000100:00100000:2.0:1787827137.359648:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580840704:0@lo:400: 00000020:01000004:1.0:1787827137.359654:0:8423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8bb88cb000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787827137.359658:0:8423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8bb88cb000 3 00000100:00100000:3.0:1787827137.359680:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580840448:12345-0@lo:400: Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.359687:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787827137.359691:0:8423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8bbacac000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.129@tcp at head 00000100:00100000:3.0:1787827137.359691:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787827137.359714:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787827137.359715:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827137.359723:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a857121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1874672580840320:12345-0@lo:38: 00000100:00100000:2.0:1787827137.359724:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672580840832:0@lo:400: 00010000:00080000:3.0:1787827137.359749:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 90 last 0 00000100:00100000:2.0:1787827137.359755:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827137.359784:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840832 00000100:00100000:2.0:1787827137.359787:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840832 00000020:00000080:3.0:1787827137.359802:0:6484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb2e8bd65d71dd8a7 00000100:00100000:2.0:1787827137.359813:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000004:00100000:3.0:1787827137.359815:0:6484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787827137.359822:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1874672580840832:12345-0@lo:400: 00000100:00080000:3.0:1787827137.359840:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f8a84df5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827137.359889:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1874672580840832:12345-0@lo:400: Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827137.359895:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787827137.359899:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a857121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3612:x1874672580840320:12345-0@lo:38: Request processed in 175us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.359906:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787827137.359928:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b867f1680 x1874672580840832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827137.359933:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840576 00000100:00100000:3.0:1787827137.359937:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840576 00000100:00100000:2.0:1787827137.359938:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672580840832:0@lo:400: 00000100:00100000:3.0:1787827137.359973:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840704 00000100:00100000:3.0:1787827137.359977:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840704 00000100:00100000:3.0:1787827137.359995:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787827137.360002:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580840576:12345-0@lo:400: 00000100:00100000:3.0:1787827137.360040:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580840576:12345-0@lo:400: Request processed in 39us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.360046:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787827137.360058:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787827137.360072:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580840704:12345-0@lo:400: 00000100:00100000:3.0:1787827137.360112:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580840704:12345-0@lo:400: Request processed in 42us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827137.360119:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787827137.360139:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580840704:0@lo:400: 00010000:00080000:3.0:1787827137.360160:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b929970c0 x1874672580840320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827137.360167:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787827137.360172:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787827137.360184:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787827137.360191:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787827137.360193:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8bbaca9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787827137.360198:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1874672580840320:0@lo:38: 00000100:00100000:3.0:1787827137.360228:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580840576:0@lo:400: 00010000:00080000:3.0:1787827137.360239:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b867f21c0 x1874672580840448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827137.360247:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580840448:0@lo:400: 00010000:00010000:1.0:1787827137.362786:0:8423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1787827137.363011:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787827137.363061:0:8423:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787827137.363077:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb2e8bd65d71dd8ae 00000100:00080000:1.0:1787827137.363087:0:8423:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827137.363093:0:8423:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f8bbacac000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827137.363130:0:8423:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b92995a40 x1874672580840960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827137.363156:0:8423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1787827137.363413:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787827137.363546:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1874672580840960:0@lo:38: 00000100:00100000:3.0:1787827137.363609:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827137.363668:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580840960 00000100:00100000:1.0:1787827137.363675:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580840960 00000100:00100000:1.0:1787827137.363708:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787827137.363724:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85711e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1874672580840960:12345-0@lo:38: 00010000:00080000:1.0:1787827137.363749:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 90 last 0 00000020:00000080:1.0:1787827137.363781:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb2e8bd65d71dd8b5 00000004:00100000:1.0:1787827137.363796:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:2.0:1787827137.363817:0:8394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00080000:1.0:1787827137.363828:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8f8bba966800 : changing import state from RECOVER to FULL 10000000:01000000:2.0:1787827137.363865:0:8394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827137.363884:0:8394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827137.363895:0:8394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.363903:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85711e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3612:x1874672580840960:12345-0@lo:38: Request processed in 184us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827137.363923:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1787827137.363945:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787827137.363948:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787827137.363949:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827137.363950:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827137.363952:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827137.363954:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827137.363955:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787827137.363957:0:8394:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827137.363958:0:8394:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827137.363960:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827137.363962:0:8394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827137.363967:0:8394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787827137.363970:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787827137.363971:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787827137.363973:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827137.363974:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827137.363980:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827137.363981:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827137.363983:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787827137.363984:0:8394:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827137.363985:0:8394:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827137.363987:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827137.363988:0:8394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787827137.364002:0:8394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00010000:00080000:1.0:1787827137.364010:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f8b92995a40 x1874672580840960/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827137.364014:0:8394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580841088:0@lo:253: 00000100:00100000:1.0:1787827137.364027:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787827137.364035:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787827137.364043:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787827137.364048:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787827137.364051:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8bbacac000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787827137.364058:0:8394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827137.364064:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1874672580840960:0@lo:38: 00000100:00100000:2.0:1787827137.364080:0:8394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd613000 going to sleep for 11 seconds 00000100:00100000:3.0:1787827137.364085:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841088 00000100:00100000:3.0:1787827137.364091:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841088 00000100:00100000:3.0:1787827137.364135:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787827137.364144:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580841088:12345-0@lo:253: 20000000:01000000:3.0:1787827137.364167:0:6479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787827137.364182:0:6479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787827137.367601:0:6479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787827137.367619:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787827137.367652:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787827137.367658:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787827137.367678:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.367692:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.367713:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.367736:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.367781:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.367796:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 16 pid: 7426 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.367809:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580841216:0@lo:104: 00000100:00100000:1.0:1787827137.367868:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827137.367874:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:8394:x1874672580841088:12345-0@lo:253: Request processed in 3729us (3815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.367892:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787827137.367909:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841216 00010000:00010000:1.0:1787827137.367918:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827137.367921:0:8394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:8394:1874672580841088:0@lo:253: 00000100:00100000:3.0:1787827137.367921:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841216 00010000:00010000:1.0:1787827137.367931:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 15 pid: 6479 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827137.367937:0:8394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:1.0:1787827137.367942:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92994000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580841344:0@lo:104: 00000020:01000004:2.0:1787827137.367943:0:8394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787827137.367947:0:8394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787827137.367950:0:8394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787827137.367952:0:8394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787827137.367953:0:8394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787827137.367956:0:8394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787827137.367957:0:8394:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787827137.367959:0:8394:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787827137.367961:0:8394:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787827137.367963:0:8394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787827137.367964:0:8394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787827137.367977:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000020:02000000:2.0:1787827137.367979:0:8394:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787827137.367980:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827137.367987:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580841216:12345-0@lo:104: 00010000:00010000:3.0:1787827137.368000:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.368001:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841344 00000100:00100000:1.0:1787827137.368005:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868180 going to sleep for 11 seconds 00000100:00100000:0.0:1787827137.368007:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841344 00000100:00100000:0.0:1787827137.368044:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787827137.368054:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827137.368055:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580841344:12345-0@lo:104: 00010000:00010000:1.0:1787827137.368059:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787827137.368061:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580841216:12345-0@lo:104: Request processed in 77us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827137.368065:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368071:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787827137.368077:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa8c00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:1.0:1787827137.368081:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368083:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368099:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580841216:0@lo:104: 00010000:00010000:1.0:1787827137.368104:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827137.368112:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827137.368118:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787827137.368143:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787827137.368145:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.368154:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580841344:12345-0@lo:104: Request processed in 100us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827137.368156:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787827137.368165:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92994000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580841344:0@lo:104: 00000100:00100000:0.0:1787827137.368171:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1787827137.368175:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368183:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8c00/0xb2e8bd65d71dd814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd81b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.368183:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368196:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827137.368199:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368202:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841472:0@lo:103: 00010000:00010000:1.0:1787827137.368206:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80030c00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:1.0:1787827137.368209:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368216:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368218:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1787827137.368226:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827137.368237:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787827137.368243:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827137.368260:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368266:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827137.368286:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.368292:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841472 00010000:00010000:1.0:1787827137.368294:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd7ff expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368294:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827137.368297:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841472 00000100:00100000:3.0:1787827137.368302:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841600:0@lo:103: 00010000:00010000:1.0:1787827137.368312:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.368314:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827137.368317:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827137.368318:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 16 pid: 7426 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368329:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827137.368356:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841600 00000100:00100000:1.0:1787827137.368360:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841600 00000100:00100000:0.0:1787827137.368361:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787827137.368373:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3613:x1874672580841472:12345-0@lo:103: 00010000:00010000:1.0:1787827137.368405:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 17 pid: 6479 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368431:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787827137.368431:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787827137.368441:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 17 pid: 7426 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.368444:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85711680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3613:x1874672580841600:12345-0@lo:103: 00010000:00010000:1.0:1787827137.368458:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827137.368462:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 17 pid: 7426 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368465:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 17 pid: 6479 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368489:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 17 pid: 6479 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368506:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd81b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd814 expref: 17 pid: 7426 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368510:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71dd7ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd7f8 expref: 17 pid: 6479 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368522:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368531:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827137.368538:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:0.0:1787827137.368543:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000976559s 00010000:00010000:0.0:1787827137.368549:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368562:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.368577:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85711680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3613:x1874672580841600:12345-0@lo:103: Request processed in 134us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827137.368578:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827137.368593:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787827137.368594:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827137.368594:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841600:0@lo:103: 00010000:00010000:0.0:1787827137.368607:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5dc00 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:0.0:1787827137.368611:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368619:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368634:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.368641:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827137.368651:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827137.368651:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827137.368660:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd8bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827137.368693:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3613:x1874672580841472:12345-0@lo:103: Request processed in 323us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827137.368700:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787827137.368872:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841472:0@lo:103: 00080000:10000000:2.0:1787827137.371693:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787827137.371822:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787827137.371977:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787827137.372072:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787827137.372204:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787827137.372346:0:8394:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787827137.373001:0:8394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787827137.376895:0:8394:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787827137.376902:0:8394:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787827137.376929:0:8394:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787827137.376963:0:8394:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787827137.376991:0:8394:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787827137.377006:0:8394:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787827137.377798:0:8394:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827137.378017:0:8394:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:1.0:1787827137.689810:0:8478:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827137.690052:0:8478:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787827138.198491:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827139.222479:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787827139.396628:0:8767:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1787827139.743328:0:8819:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827139.743576:0:8819:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787827140.246536:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827140.502598:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827140.502622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580841728:0@lo:41: 00000100:00100000:1.0:1787827140.502689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.502731:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841728 00000100:00100000:3.0:1787827140.502738:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841728 00000100:00100000:1.0:1787827140.502744:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85712580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580841856:0@lo:41: 00000100:00100000:1.0:1787827140.502778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827140.502875:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841856 00000100:00100000:3.0:1787827140.502880:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841856 00000100:00100000:3.0:1787827140.502905:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787827140.502913:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580841728:12345-0@lo:41: 00000004:00000024:3.0:1787827140.502944:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787827140.502997:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580841728:12345-0@lo:41: Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.503006:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787827140.503024:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787827140.503031:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580841856:12345-0@lo:41: 00000100:00100000:1.0:1787827140.503036:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580841728:0@lo:41: 00000004:00000024:3.0:1787827140.503048:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1787827140.503086:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92994780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580841856:12345-0@lo:41: Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827140.503093:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787827140.503103:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85712580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580841856:0@lo:41: 00010000:00010000:1.0:1787827141.270479:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827141.405191:0:8920:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827141.405454:0:8920:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1787827141.744219:0:8968:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827141.744228:0:8968:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787827142.294498:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827142.550566:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841984:0@lo:400: 00000100:00100000:2.0:1787827142.550572:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1874672580842112:0@lo:400: 00000100:00100000:2.0:1787827142.550642:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.550646:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580842368:0@lo:400: 00000100:00100000:1.0:1787827142.550649:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.550706:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827142.550714:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1874672580842624:0@lo:400: 00000100:00100000:1.0:1787827142.550721:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1874672580842496:0@lo:400: 00000100:00100000:0.0:1787827142.550738:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787827142.550747:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580842240:0@lo:400: 00000100:00100000:2.0:1787827142.550754:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827142.550776:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580841984 00000100:00100000:1.0:1787827142.550783:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580841984 00000100:00100000:1.0:1787827142.550841:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787827142.550857:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3613:x1874672580841984:12345-0@lo:400: 00000100:00100000:3.0:1787827142.551095:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842112 00000100:00100000:3.0:1787827142.551100:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842112 00000100:00100000:3.0:1787827142.551128:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842624 00000100:00100000:3.0:1787827142.551131:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842624 00000100:00100000:3.0:1787827142.551159:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787827142.551169:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1874672580842112:12345-0@lo:400: 00000100:00100000:0.0:1787827142.551186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787827142.551189:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827142.551195:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:3613:x1874672580841984:12345-0@lo:400: Request processed in 338us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.551206:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787827142.551208:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827142.551221:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672580842752:0@lo:400: 00000100:00100000:2.0:1787827142.551245:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580841984:0@lo:400: 00000100:00100000:3.0:1787827142.551252:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1874672580842112:12345-0@lo:400: Request processed in 83us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.551256:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842496 00000100:00100000:0.0:1787827142.551263:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827142.551266:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787827142.551272:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842496 00000100:00100000:3.0:1787827142.551289:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842752 00010000:00080000:2.0:1787827142.551291:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b92a0d2c0 x1874672580842112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827142.551295:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842752 00000100:00100000:0.0:1787827142.551298:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842368 00000100:00100000:1.0:1787827142.551304:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827142.551306:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842368 00000100:00100000:2.0:1787827142.551308:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1874672580842112:0@lo:400: 00000100:00100000:1.0:1787827142.551318:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1874672580842624:12345-0@lo:400: 00000100:00080000:2.0:1787827142.551332:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827142.551344:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787827142.551349:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842240 00000100:00100000:0.0:1787827142.551354:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842240 00000100:00100000:3.0:1787827142.551356:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1874672580842496:12345-0@lo:400: 00000100:00100000:2.0:1787827142.551359:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787827142.551374:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b91775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580842368:12345-0@lo:400: 00000100:00100000:1.0:1787827142.551402:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1874672580842624:12345-0@lo:400: Request processed in 63us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.551407:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787827142.551417:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827142.551428:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580842240:12345-0@lo:400: 00000100:00100000:1.0:1787827142.551440:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827142.551449:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b91775680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580842368:12345-0@lo:400: Request processed in 78us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827142.551454:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672580842752:12345-0@lo:400: 00000100:00100000:3.0:1787827142.551459:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1874672580842496:12345-0@lo:400: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827142.551461:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787827142.551474:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787827142.551476:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580842240:12345-0@lo:400: Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827142.551487:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787827142.551503:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b92a0c780 x1874672580842496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827142.551509:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874672580842752:12345-0@lo:400: Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827142.551520:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1874672580842496:0@lo:400: 00000100:00100000:1.0:1787827142.551525:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787827142.551543:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b92a0d680 x1874672580842624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827142.551554:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1874672580842624:0@lo:400: 00000100:00100000:2.0:1787827142.551558:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580842240:0@lo:400: 00010000:00080000:2.0:1787827142.551578:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b92a0f0c0 x1874672580842752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827142.551587:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1874672580842752:0@lo:400: 00000100:00100000:2.0:1787827142.551606:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580842368:0@lo:400: 00010000:00010000:2.0:1787827143.319481:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827144.343158:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787827145.110456:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787827145.110462:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bba965800 from 30 10000000:01000000:0.0:1787827145.110467:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787827145.110506:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.110516:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.110527:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.110549:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580842880:0@lo:101: 00000100:00100000:0.0:1787827145.110614:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.110655:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580842880 00000100:00100000:0.0:1787827145.110660:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.110662:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580842880 00000100:00100000:2.0:1787827145.110717:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787827145.110728:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580842880:12345-0@lo:101: 00010000:00010000:2.0:1787827145.110741:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.110754:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd8c3 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.110776:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.110799:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.110809:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bb5f0ae00, rc 0) 00000100:00100000:2.0:1787827145.110860:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580842880:12345-0@lo:101: Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.110868:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787827145.111194:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580842880:0@lo:101: 00010000:00010000:0.0:1787827145.111208:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.111218:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.111281:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843008:0@lo:501: 00000100:00100000:0.0:1787827145.111310:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.111330:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.111353:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843008 00000100:00100000:2.0:1787827145.111359:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843008 00000100:00100000:2.0:1787827145.111416:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787827145.111425:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580843008:12345-0@lo:501: 00000100:00100000:2.0:1787827145.111540:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580843008:12345-0@lo:501: Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.111548:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787827145.111557:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843008:0@lo:501: 00000100:00100000:0.0:1787827145.111592:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843136:0@lo:503: 00000100:00100000:0.0:1787827145.111630:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.111660:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.111698:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843136 00000100:00100000:1.0:1787827145.111701:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843136 00000100:00100000:1.0:1787827145.111727:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787827145.111735:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580843136:12345-0@lo:503: 00000100:00100000:1.0:1787827145.111848:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580843136:12345-0@lo:503: Request processed in 114us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.111853:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787827145.111901:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843136:0@lo:503: 00000100:00100000:2.0:1787827145.112172:0:9439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9439:1874672580843264:0@lo:502: 00000100:00100000:2.0:1787827145.112210:0:9439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.112237:0:9439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.112250:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843264 00000100:00100000:1.0:1787827145.112256:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843264 00000100:00100000:1.0:1787827145.112283:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787827145.112291:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9439:x1874672580843264:12345-0@lo:502: 00000100:00100000:1.0:1787827145.112374:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9439:x1874672580843264:12345-0@lo:502: Request processed in 84us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.112413:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787827145.112798:0:9439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9439:1874672580843264:0@lo:502: 00000100:00100000:2.0:1787827145.112840:0:9439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9439:1874672580843392:0@lo:502: 00000100:00100000:2.0:1787827145.112874:0:9439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.112906:0:9439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.112911:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843392 00000100:00100000:1.0:1787827145.112916:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843392 00000100:00100000:1.0:1787827145.112947:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787827145.112954:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9439:x1874672580843392:12345-0@lo:502: 00000100:00100000:1.0:1787827145.113031:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9439:x1874672580843392:12345-0@lo:502: Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.113038:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787827145.113061:0:9439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9439:1874672580843392:0@lo:502: 00000040:00080000:2.0:1787827145.113084:0:9439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787827145.113145:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787827145.113178:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787827145.113194:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.113204:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827145.113213:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787827145.113216:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8bba965800 from 5 10000000:01000000:0.0:1787827145.113225:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787827145.113243:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.113249:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.113255:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.113263:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843520:0@lo:101: 00000100:00100000:0.0:1787827145.113288:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.113305:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.113322:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843520 00000100:00100000:2.0:1787827145.113328:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843520 00000100:00100000:2.0:1787827145.113353:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787827145.113360:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580843520:12345-0@lo:101: 00010000:00010000:2.0:1787827145.113368:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.113400:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd8d1 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.113418:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.113430:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.113438:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bb5f0a800, rc 0) 00000100:00100000:2.0:1787827145.113472:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580843520:12345-0@lo:101: Request processed in 112us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.113480:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787827145.113497:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843520:0@lo:101: 00010000:00010000:0.0:1787827145.113511:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.113520:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.113568:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843648:0@lo:256: 00000100:00100000:0.0:1787827145.113602:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.113629:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.113639:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843648 00000100:00100000:1.0:1787827145.113644:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843648 00000100:00100000:1.0:1787827145.113676:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787827145.113684:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580843648:12345-0@lo:256: 20000000:01000000:1.0:1787827145.113697:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787827145.113720:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787827145.113723:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787827145.113814:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580843648:12345-0@lo:256: Request processed in 131us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.113822:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787827145.114013:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843648:0@lo:256: 10000000:01000000:0.0:1787827145.114063:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787827145.114069:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.114076:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827145.114088:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787827145.114090:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787827145.114093:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787827145.114108:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.114116:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.114123:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.114136:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843776:0@lo:101: 00000100:00100000:0.0:1787827145.114167:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.114198:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.114212:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843776 00000100:00100000:2.0:1787827145.114218:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843776 00000100:00100000:2.0:1787827145.114248:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787827145.114257:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580843776:12345-0@lo:101: 00010000:00010000:2.0:1787827145.114264:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.114273:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd8df expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.114288:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.114296:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.114302:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bb5f0b800, rc 0) 00000100:00100000:2.0:1787827145.114336:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580843776:12345-0@lo:101: Request processed in 81us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.114343:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787827145.114366:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843776:0@lo:101: 00010000:00010000:0.0:1787827145.114397:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.114406:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.114457:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843904:0@lo:501: 00000100:00100000:0.0:1787827145.114488:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.114518:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.114523:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580843904 00000100:00100000:2.0:1787827145.114528:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580843904 00000100:00100000:2.0:1787827145.114556:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787827145.114563:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580843904:12345-0@lo:501: 00000100:00100000:2.0:1787827145.114648:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580843904:12345-0@lo:501: Request processed in 85us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.114655:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787827145.114679:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580843904:0@lo:501: 00000100:00100000:0.0:1787827145.114707:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580844032:0@lo:503: 00000100:00100000:0.0:1787827145.114758:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.114776:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.114781:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844032 00000100:00100000:2.0:1787827145.114785:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844032 00000100:00100000:2.0:1787827145.114826:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787827145.114831:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580844032:12345-0@lo:503: 00000100:00100000:2.0:1787827145.114921:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580844032:12345-0@lo:503: Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.114928:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787827145.115653:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580844032:0@lo:503: 00000100:00100000:2.0:1787827145.116070:0:9440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9440:1874672580844160:0@lo:502: 00000100:00100000:2.0:1787827145.116114:0:9440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.116147:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844160 00000100:00100000:2.0:1787827145.116152:0:9440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.116153:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844160 00000100:00100000:1.0:1787827145.116188:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787827145.116198:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9440:x1874672580844160:12345-0@lo:502: 00000100:00100000:1.0:1787827145.116281:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9440:x1874672580844160:12345-0@lo:502: Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.116287:0:9440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9440:1874672580844160:0@lo:502: 00000100:00100000:1.0:1787827145.116290:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000020:01000000:2.0:1787827145.116310:0:9440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787827145.116315:0:9440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787827145.116321:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827145.116322:0:9440:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787827145.116328:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787827145.116331:0:9440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787827145.116347:0:9440:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787827145.116348:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787827145.116358:0:9440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f8bba7d99b8) 00000020:00000080:2.0:1787827145.116373:0:9440:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787827145.116400:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787827145.116476:0:9440:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787827145.116482:0:9440:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787827145.116487:0:9440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dd8f4 00010000:00080000:2.0:1787827145.116507:0:9440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a861d6800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787827145.116701:0:9440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787827145.119759:0:9440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787827145.119777:0:9440:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787827145.120003:0:9440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827145.120271:0:9440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827145.120416:0:9440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787827145.120551:0:9440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787827145.120785:0:9441:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787827145.120802:0:9441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787827145.121450:0:9440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787827145.121462:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787827145.121508:0:9440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787827145.121530:0:9440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dd8fb 00000100:00080000:3.0:1787827145.121540:0:9440:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827145.121546:0:9440:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f8a861d6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787827145.121581:0:9440:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a85710780 x1874672580844288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787827145.121606:0:9440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787827145.121638:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85710780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580844288:0@lo:8: 00000020:01000000:3.0:1787827145.121679:0:9440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827145.121685:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.121687:0:9440:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787827145.121692:0:9440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827145.121696:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1787827145.121700:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787827145.121701:0:9440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787827145.121709:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787827145.121711:0:9440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787827145.121727:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827145.121740:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580844672:0@lo:400: 00000100:00100000:3.0:1787827145.121785:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.121811:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580844416:0@lo:400: 00000100:00100000:3.0:1787827145.121842:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580844544:0@lo:400: 00000100:00100000:1.0:1787827145.121850:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844672 00000100:00100000:1.0:1787827145.121859:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844672 00000100:00100000:0.0:1787827145.121876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.121893:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.121907:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844544 00000100:00100000:1.0:1787827145.121912:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844544 00000100:00100000:0.0:1787827145.121913:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580844928:0@lo:400: 00000100:00100000:3.0:1787827145.121927:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827145.121937:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580845056:0@lo:400: 00000100:00100000:1.0:1787827145.121943:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787827145.121952:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.121957:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a857130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580844672:12345-0@lo:400: 00000100:00100000:3.0:1787827145.121981:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.121987:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827145.121996:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580844800:0@lo:400: 00000100:00100000:3.0:1787827145.122028:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844416 00000100:00100000:3.0:1787827145.122034:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844416 00000100:00100000:0.0:1787827145.122038:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.122044:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a857130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580844672:12345-0@lo:400: Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.122054:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787827145.122069:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844928 00000100:00100000:3.0:1787827145.122073:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844928 00000100:00100000:1.0:1787827145.122080:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787827145.122091:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85712580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580844544:12345-0@lo:400: 00000100:00100000:0.0:1787827145.122102:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844288 00000100:00100000:0.0:1787827145.122107:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844288 00000100:00080000:2.0:1787827145.122109:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827145.122114:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845056 00000100:00100000:3.0:1787827145.122120:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845056 00000100:00100000:0.0:1787827145.122138:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787827145.122148:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85712580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580844544:12345-0@lo:400: Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.122152:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1874672580844288:12345-0@lo:8: 00000100:00100000:3.0:1787827145.122154:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580844800 00000100:00100000:3.0:1787827145.122160:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580844800 00000100:00100000:1.0:1787827145.122161:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787827145.122171:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787827145.122177:0:8400:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 97 last 0 00000100:00100000:3.0:1787827145.122188:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787827145.122198:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580844416:12345-0@lo:400: 00000020:00000080:0.0:1787827145.122218:0:8400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dd902 00000100:00100000:3.0:1787827145.122250:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580844416:12345-0@lo:400: Request processed in 54us (375us total) trans 0 rc 0/0 00002000:00100000:0.0:1787827145.122251:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f8a8571f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113941 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787827145.122259:0:8400:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787827145.122263:0:8400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787827145.122264:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787827145.122283:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8b92b90f00 x1874672580844416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.122288:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00002000:00100000:0.0:1787827145.122300:0:8400:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787827145.122302:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580844928:12345-0@lo:400: 00000100:00100000:1.0:1787827145.122303:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580844416:0@lo:400: 00000100:00100000:3.0:1787827145.122350:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580844928:12345-0@lo:400: Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.122358:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787827145.122364:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd355a40 x1874672580844928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.122393:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580844928:0@lo:400: 00000100:00100000:3.0:1787827145.122400:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787827145.122411:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580845056:12345-0@lo:400: 00000100:00100000:3.0:1787827145.122449:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580845056:12345-0@lo:400: Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.122456:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787827145.122484:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787827145.122494:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580844800:12345-0@lo:400: 00000100:00100000:3.0:1787827145.122545:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580844800:12345-0@lo:400: Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.122556:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787827145.122565:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd3543c0 x1874672580844800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.122583:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580844800:0@lo:400: 00002000:00080000:0.0:1787827145.122587:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00010000:00080000:3.0:1787827145.122598:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd357c00 x1874672580845056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.122610:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580845056:0@lo:400: 00000100:00080000:0.0:1787827145.122614:0:8400:0:(import.c:65:import_set_state_nolock()) ffff8f8a8571c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827145.122626:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580844672:0@lo:400: 00000100:00100000:3.0:1787827145.122637:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580844544:0@lo:400: 00000100:00100000:0.0:1787827145.122662:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92994000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3612:x1874672580844288:12345-0@lo:8: Request processed in 511us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.122668:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787827145.122679:0:9440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9440:1874672580845184:0@lo:502: 00010000:00080000:1.0:1787827145.122680:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85710780 x1874672580844288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.122692:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787827145.122699:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1787827145.122706:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787827145.122712:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787827145.122715:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8a861d6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787827145.122729:0:9440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787827145.122737:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787827145.122752:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85710780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580844288:0@lo:8: 00000100:00100000:3.0:1787827145.122765:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845184 00000100:00100000:3.0:1787827145.122771:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845184 00000100:00100000:0.0:1787827145.122772:0:9442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580845312:0@lo:700: 00000004:00080000:1.0:1787827145.122775:0:9441:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787827145.122824:0:9442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787827145.122828:0:9441:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 97772448422ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787827145.122829:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00080000:00080000:1.0:1787827145.122837:0:9441:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787827145.122844:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9440:x1874672580845184:12345-0@lo:502: 00000100:00100000:0.0:1787827145.122862:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845312 00000100:00100000:0.0:1787827145.122866:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845312 00000100:00080000:1.0:1787827145.122889:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827145.122903:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787827145.122911:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd354b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9442:x1874672580845312:12345-0@lo:700: 00000100:00100000:0.0:1787827145.122938:0:8409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8409:1874672580845440:0@lo:700: 00000100:00100000:3.0:1787827145.122945:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9440:x1874672580845184:12345-0@lo:502: Request processed in 104us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.122954:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787827145.122971:0:8409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.122996:0:8409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.123009:0:9442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847300 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.123012:0:7447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845440 00000100:00100000:1.0:1787827145.123017:0:7447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845440 00000100:00100000:1.0:1787827145.123044:0:7447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827145.123051:0:7447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0000_UUID+5:8409:x1874672580845440:12345-0@lo:700: 00000100:00100000:3.0:1787827145.123197:0:9440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.123211:0:9440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9440:1874672580845184:0@lo:502: 00000020:01000000:3.0:1787827145.123236:0:9440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827145.123240:0:9440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.123242:0:9440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787827145.123246:0:9440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1787827145.123299:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1787827145.123326:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787827145.123336:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.123359:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827145.123367:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787827145.123369:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8b98781000 from 30 10000000:01000000:1.0:1787827145.123371:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787827145.123420:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.123426:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.123431:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.123441:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845568:0@lo:101: 00000100:00100000:1.0:1787827145.123467:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.123508:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcdc0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.123547:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845568 00000100:00100000:3.0:1787827145.123552:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845568 00000100:00100000:3.0:1787827145.123587:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787827145.123597:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580845568:12345-0@lo:101: 00010000:00010000:3.0:1787827145.123606:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827145.123618:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd909 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.123640:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.123651:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.123660:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9400, rc 0) 00000100:00100000:3.0:1787827145.123695:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580845568:12345-0@lo:101: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.123703:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845568:0@lo:101: 00000100:00100000:3.0:1787827145.123704:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:1.0:1787827145.123718:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.123725:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.123766:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845696:0@lo:501: 00000100:00100000:1.0:1787827145.123806:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.123832:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcdc0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.123840:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845696 00000100:00100000:2.0:1787827145.123846:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845696 00000100:00100000:2.0:1787827145.123873:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787827145.123880:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580845696:12345-0@lo:501: 00000100:00100000:2.0:1787827145.123989:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580845696:12345-0@lo:501: Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.123997:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787827145.124006:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845696:0@lo:501: 00000100:00100000:1.0:1787827145.124033:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845824:0@lo:503: 00000100:00100000:1.0:1787827145.124073:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.124089:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcdc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.124090:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845824 00000100:00100000:0.0:1787827145.124096:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845824 00000100:00100000:0.0:1787827145.124129:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787827145.124139:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580845824:12345-0@lo:503: 00000100:00100000:0.0:1787827145.124243:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580845824:12345-0@lo:503: Request processed in 104us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.124251:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787827145.124261:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92995a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580845824:0@lo:503: 00000004:00080000:3.0:1787827145.124289:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787827145.124711:0:9443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd354000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9443:1874672580845952:0@lo:502: 00000100:00100000:0.0:1787827145.124745:0:9443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.124772:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580845952 00000100:00100000:3.0:1787827145.124777:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580845952 00000100:00100000:0.0:1787827145.124785:0:9443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.124826:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787827145.124836:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:9443:x1874672580845952:12345-0@lo:502: 00000100:00100000:3.0:1787827145.124923:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:9443:x1874672580845952:12345-0@lo:502: Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.124932:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787827145.124965:0:9443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd354000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9443:1874672580845952:0@lo:502: 00000100:00100000:0.0:1787827145.125014:0:9443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd354000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9443:1874672580846080:0@lo:502: 00000100:00100000:0.0:1787827145.125057:0:9443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.125077:0:9443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.125080:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846080 00000100:00100000:2.0:1787827145.125086:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846080 00000100:00100000:2.0:1787827145.125120:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787827145.125130:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:9443:x1874672580846080:12345-0@lo:502: 00000100:00100000:2.0:1787827145.125288:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:9443:x1874672580846080:12345-0@lo:502: Request processed in 160us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.125298:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 40000000:02000000:0.0:1787827145.125303:0:7447:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1787827145.125350:0:9443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd354000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9443:1874672580846080:0@lo:502: 00000040:00080000:2.0:1787827145.125374:0:9443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787827145.126135:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787827145.126157:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827145.126165:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126176:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827145.126184:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827145.126187:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8b98781000 from 5 10000000:01000000:2.0:1787827145.126189:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787827145.126212:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126219:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126234:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.126249:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846208:0@lo:101: 00000100:00100000:2.0:1787827145.126286:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.126321:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.126342:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846208 00000100:00100000:1.0:1787827145.126348:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846208 00000100:00100000:1.0:1787827145.126410:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787827145.126421:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580846208:12345-0@lo:101: 00010000:00010000:1.0:1787827145.126430:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827145.126449:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd917 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.126472:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.126487:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.126495:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5dc00, rc 0) 00000100:00100000:1.0:1787827145.126533:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580846208:12345-0@lo:101: Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.126541:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787827145.126546:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846208:0@lo:101: 00010000:00010000:2.0:1787827145.126558:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126563:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.126600:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846336:0@lo:256: 00000100:00100000:2.0:1787827145.126634:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.126662:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.126679:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846336 00000100:00100000:2.0:1787827145.126683:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846336 00000100:00100000:2.0:1787827145.126717:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787827145.126724:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580846336:12345-0@lo:256: 20000000:01000000:2.0:1787827145.126736:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787827145.126750:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787827145.126753:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787827145.126845:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580846336:12345-0@lo:256: Request processed in 122us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.126852:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787827145.126893:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846336:0@lo:256: 10000000:01000000:2.0:1787827145.126933:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787827145.126940:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126948:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827145.126955:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787827145.126958:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787827145.126960:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787827145.126976:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126984:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.126991:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.127003:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846464:0@lo:101: 00000100:00100000:2.0:1787827145.127032:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.127051:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.127060:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846464 00000100:00100000:3.0:1787827145.127066:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846464 00000100:00100000:3.0:1787827145.127099:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787827145.127117:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580846464:12345-0@lo:101: 00010000:00010000:3.0:1787827145.127125:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827145.127136:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd925 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.127153:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.127162:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.127169:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8200, rc 0) 00000100:00100000:3.0:1787827145.127209:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580846464:12345-0@lo:101: Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.127217:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846464:0@lo:101: 00000100:00100000:3.0:1787827145.127218:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1787827145.127233:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.127242:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.127303:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846592:0@lo:501: 00000100:00100000:2.0:1787827145.127335:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.127351:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.127365:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846592 00000100:00100000:2.0:1787827145.127369:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846592 00000100:00100000:2.0:1787827145.127419:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787827145.127427:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580846592:12345-0@lo:501: 00000100:00100000:2.0:1787827145.127522:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580846592:12345-0@lo:501: Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.127530:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787827145.127540:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846592:0@lo:501: 00000100:00100000:3.0:1787827145.127571:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846720:0@lo:503: 00000100:00100000:3.0:1787827145.127606:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.127629:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846720 00000100:00100000:3.0:1787827145.127633:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913540 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.127635:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846720 00000100:00100000:2.0:1787827145.127670:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787827145.127678:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580846720:12345-0@lo:503: 00000100:00100000:2.0:1787827145.127760:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580846720:12345-0@lo:503: Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.127768:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787827145.127785:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580846720:0@lo:503: 00000100:00100000:2.0:1787827145.128005:0:9444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9444:1874672580846848:0@lo:502: 00000100:00100000:2.0:1787827145.128043:0:9444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.128064:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846848 00000100:00100000:2.0:1787827145.128067:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846848 00000100:00100000:2.0:1787827145.128087:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787827145.128093:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:9444:x1874672580846848:12345-0@lo:502: 00000100:00100000:2.0:1787827145.128154:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:9444:x1874672580846848:12345-0@lo:502: Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.128168:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787827145.128198:0:9444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861af900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.128211:0:9444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9444:1874672580846848:0@lo:502: 00000020:01000000:2.0:1787827145.128231:0:9444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787827145.128237:0:9444:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787827145.128243:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827145.128246:0:9444:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787827145.128252:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787827145.128256:0:9444:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787827145.128280:0:9444:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787827145.128283:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787827145.128304:0:9444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f8bbf9acd28) 00000020:00000080:2.0:1787827145.128320:0:9444:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787827145.128327:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787827145.128413:0:9444:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787827145.128418:0:9444:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787827145.128423:0:9444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71dd93a 00010000:00080000:2.0:1787827145.128449:0:9444:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8bbf9bb800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787827145.128634:0:9444:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1787827145.130698:0:7447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0002:lustre-MDT0000-lwp-OST0000_UUID+5:8409:x1874672580845440:12345-0@lo:700: Request processed in 7642us (7722us total) trans 0 rc 0/0 00010000:00080000:1.0:1787827145.130714:0:8409:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd355680 x1874672580845440/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.130727:0:7447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827145.130732:0:8409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8409:1874672580845440:0@lo:700: 40000000:02000000:1.0:1787827145.130746:0:8409:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1787827145.134795:0:9444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787827145.134816:0:9444:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787827145.135027:0:9444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00100000:0.0:1787827145.135030:0:8396:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787827145.135226:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd354b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580845312:12345-0@lo:700: Request processed in 12311us (12399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.135243:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1787827145.135261:0:9444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1787827145.135316:0:9442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd355e00 x1874672580845312/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.135331:0:9442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580845312:0@lo:700: 00000040:00080000:3.0:1787827145.135531:0:9444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787827145.135649:0:9444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787827145.136582:0:9448:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787827145.136589:0:9448:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787827145.136964:0:9444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787827145.136977:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787827145.137017:0:9444:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787827145.137040:0:9444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71dd941 00000100:00080000:0.0:1787827145.137048:0:9444:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787827145.137054:0:9444:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f8bbf9bb800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787827145.137083:0:9444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8bbd355e00 x1874672580846976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787827145.137106:0:9444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787827145.137131:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580846976:0@lo:8: 00000020:01000000:0.0:1787827145.137168:0:9444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827145.137174:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827145.137177:0:9444:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787827145.137182:0:9444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827145.137188:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827145.137190:0:9444:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000100:00100000:1.0:1787827145.137196:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787827145.137198:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787827145.137202:0:9444:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787827145.137228:0:9444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9444:1874672580847104:0@lo:502: 00000100:00100000:2.0:1787827145.137238:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580846976 00000100:00100000:2.0:1787827145.137246:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580846976 00000100:00100000:0.0:1787827145.137277:0:9444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.137283:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827145.137292:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b929943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1874672580846976:12345-0@lo:8: 00000100:00100000:0.0:1787827145.137300:0:9444:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847180 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.137305:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847104 00000100:00100000:1.0:1787827145.137310:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847104 00010000:00080000:2.0:1787827145.137317:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 97 last 0 00000100:00100000:1.0:1787827145.137342:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000020:00000080:2.0:1787827145.137346:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71dd948 00000100:00100000:1.0:1787827145.137350:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:9444:x1874672580847104:12345-0@lo:502: 00002000:00100000:2.0:1787827145.137361:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f8bbf9bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113941 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787827145.137368:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787827145.137408:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787827145.137475:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:9444:x1874672580847104:12345-0@lo:502: Request processed in 123us (196us total) trans 0 rc 0/0 00002000:00080000:2.0:1787827145.137478:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787827145.137485:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1787827145.137507:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8f8bbf9bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827145.137555:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b929943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3612:x1874672580846976:12345-0@lo:8: Request processed in 263us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.137563:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787827145.137566:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd355e00 x1874672580846976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.137573:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787827145.137579:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787827145.137583:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787827145.137587:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787827145.137589:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8bbf9bb800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787827145.137600:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787827145.137604:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580846976:0@lo:8: 00000004:00080000:1.0:1787827145.137635:0:9448:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787827145.137679:0:9448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 97787300107ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787827145.137687:0:9448:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787827145.138080:0:9444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:9444:1874672580847104:0@lo:502: 00000020:01000000:0.0:1787827145.138111:0:9444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787827145.138121:0:9444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827145.138123:0:9444:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787827145.138128:0:9444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787827145.138141:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580847232:0@lo:13: 00000100:00100000:1.0:1787827145.138177:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.138219:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847232 00000100:00100000:2.0:1787827145.138225:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847232 00000020:01000000:0.0:1787827145.138250:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1787827145.138264:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827145.138273:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580847232:12345-0@lo:13: 10000000:01000000:0.0:1787827145.138280:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787827145.138290:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1787827145.138292:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:3.0:1787827145.138292:0:9442:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00010000:00010000:0.0:1787827145.138307:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827145.138317:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:3.0:1787827145.138318:0:9442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580847360:0@lo:7: 10000000:01000000:0.0:1787827145.138320:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b988b19b8 from 1 10000000:01000000:0.0:1787827145.138324:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787827145.138348:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.138357:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.138366:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.138400:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580847488:0@lo:101: 00010000:00080000:1.0:1787827145.138568:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85712d00 x1874672580847232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827145.138573:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92995680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580847232:12345-0@lo:13: Request processed in 299us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.138590:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787827145.138594:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85712d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580847232:0@lo:13: 00000100:00100000:3.0:1787827145.138594:0:9442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.138611:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.138617:0:9442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.138647:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86847180 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.138648:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847488 00000100:00100000:1.0:1787827145.138654:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847488 00000100:00100000:1.0:1787827145.138687:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787827145.138694:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580847488:12345-0@lo:101: 00010000:00010000:1.0:1787827145.138702:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827145.138715:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd94f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.138736:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.138740:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847360 00000100:00100000:0.0:1787827145.138745:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847360 00010000:00010000:1.0:1787827145.138751:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.138761:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5c400, rc 0) 00000100:00100000:0.0:1787827145.138798:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827145.138812:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85713c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580847360:12345-0@lo:7: 00000100:00100000:1.0:1787827145.138813:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580847488:12345-0@lo:101: Request processed in 115us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.138824:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787827145.139452:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580847488:0@lo:101: 00010000:00010000:1.0:1787827145.139468:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.139478:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787827145.139489:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787827145.139549:0:9449:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787827145.139556:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580847744:0@lo:501: 00000100:00100000:3.0:1787827145.139569:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580847872:0@lo:7: 00000100:00100000:1.0:1787827145.139596:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.139618:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.139641:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b99306000 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.139645:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.139657:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787827145.139668:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a857103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580847616:0@lo:13: 00000100:00100000:1.0:1787827145.139695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.139726:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847744 00000100:00100000:3.0:1787827145.139727:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847616 00000100:00100000:1.0:1787827145.139729:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847744 00000100:00100000:3.0:1787827145.139732:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847616 00000100:00100000:1.0:1787827145.139759:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787827145.139766:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580847744:12345-0@lo:501: 00000100:00100000:2.0:1787827145.139776:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787827145.139776:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827145.139784:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787827145.139785:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672580847616:12345-0@lo:13: 00002000:00000024:3.0:1787827145.139810:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1787827145.139850:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580847744:12345-0@lo:501: Request processed in 83us (255us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827145.139862:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787827145.139862:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92995a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672580847616:12345-0@lo:13: Request processed in 76us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.139873:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787827145.139900:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787827145.139927:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a857103c0 x1874672580847616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.139942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a857103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580847616:0@lo:13: 00000100:00100000:1.0:1787827145.139974:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580847744:0@lo:501: 10000000:01000000:1.0:1787827145.140007:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787827145.140014:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.140022:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.140312:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580847872 00000100:00100000:2.0:1787827145.140317:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580847872 00000100:00100000:2.0:1787827145.140430:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787827145.140440:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85711a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9449:x1874672580847872:12345-0@lo:7: 00002000:00080000:0.0:1787827145.142374:0:8400:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787827145.142410:0:8400:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787827145.142482:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85713c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580847360:12345-0@lo:7: Request processed in 3674us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.142492:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787827145.142510:0:9442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85713840 x1874672580847360/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.142524:0:9442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580847360:0@lo:7: 00000004:00080000:3.0:1787827145.142539:0:9442:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787827145.142568:0:9442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580848000:0@lo:5: 00000100:00100000:3.0:1787827145.142596:0:9442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.142617:0:9442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.142623:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848000 00000100:00100000:0.0:1787827145.142629:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848000 00000100:00100000:0.0:1787827145.142666:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787827145.142676:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a857103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580848000:12345-0@lo:5: 00000100:00100000:3.0:1787827145.142679:0:8403:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787827145.142688:0:8403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:0.0:1787827145.142698:0:8402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1787827145.142739:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a857103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580848000:12345-0@lo:5: Request processed in 64us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.142746:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787827145.142753:0:9442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85713840 x1874672580848000/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.142762:0:9442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580848000:0@lo:5: 00000004:00080000:3.0:1787827145.142775:0:9442:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787827145.142809:0:9442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580848128:0@lo:5: 00000100:00100000:3.0:1787827145.142829:0:9442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.142843:0:9442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.142853:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848128 00000100:00100000:0.0:1787827145.142858:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848128 00000100:00100000:0.0:1787827145.142889:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787827145.142897:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85712d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9442:x1874672580848128:12345-0@lo:5: 00002000:00080000:0.0:1787827145.142921:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787827145.145519:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85712d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9442:x1874672580848128:12345-0@lo:5: Request processed in 2619us (2683us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787827145.145531:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787827145.145577:0:9442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85713840 x1874672580848128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.145592:0:9442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9442:1874672580848128:0@lo:5: 00000004:00080000:0.0:1787827145.145605:0:9442:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1787827145.145636:0:9442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9442:1874672580848256:0@lo:900: 00000100:00100000:0.0:1787827145.145672:0:9442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.145697:0:9442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b868473c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.145717:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848256 00000100:00100000:3.0:1787827145.145723:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848256 00000100:00100000:3.0:1787827145.145770:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787827145.145782:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9442:x1874672580848256:12345-0@lo:900: 00000100:00100000:3.0:1787827145.145855:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9442:x1874672580848256:12345-0@lo:900: Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.145864:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787827145.145870:0:9442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd356580 x1874672580848256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.145882:0:9442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:9442:1874672580848256:0@lo:900: 00002000:00080000:2.0:1787827145.147228:0:9450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787827145.147235:0:9450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787827145.147288:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85711a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9449:x1874672580847872:12345-0@lo:7: Request processed in 6849us (7669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.147297:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787827145.147327:0:9449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85710f00 x1874672580847872/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.147347:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580847872:0@lo:7: 00000004:00080000:3.0:1787827145.147358:0:9449:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787827145.147401:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848384:0@lo:5: 00000100:00100000:3.0:1787827145.147431:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.147452:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.147457:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848384 00000100:00100000:2.0:1787827145.147462:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848384 00000100:00100000:2.0:1787827145.147492:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787827145.147500:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9449:x1874672580848384:12345-0@lo:5: 00002000:00080000:2.0:1787827145.147529:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787827145.147532:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1787827145.150187:0:8396:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:0.0:1787827145.150211:0:8396:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787827145.150219:0:8396:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787827145.150352:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9449:x1874672580848384:12345-0@lo:5: Request processed in 2849us (2917us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787827145.150363:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787827145.150422:0:9449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85710f00 x1874672580848384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.150433:0:9449:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787827145.150439:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848384:0@lo:5: 00000004:00080000:0.0:1787827145.150453:0:9449:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787827145.150494:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848512:0@lo:700: 00000100:00100000:0.0:1787827145.150529:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.150554:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b868473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.150569:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848512 00000100:00100000:2.0:1787827145.150575:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848512 00000100:00100000:2.0:1787827145.150611:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787827145.150618:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9449:x1874672580848512:12345-0@lo:700: 00000100:00100000:2.0:1787827145.154813:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9449:x1874672580848512:12345-0@lo:700: Request processed in 4188us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.154826:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787827145.154841:0:9449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd356580 x1874672580848512/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.154857:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848512:0@lo:700: 00000004:02000040:0.0:1787827145.155696:0:9449:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1787827145.159522:0:9449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848640:0@lo:5: 00000100:00100000:0.0:1787827145.159584:0:9449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.159624:0:9449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b868473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.159703:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848640 00000100:00100000:2.0:1787827145.159711:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848640 00000100:00100000:2.0:1787827145.159762:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787827145.159773:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9449:x1874672580848640:12345-0@lo:5: 00002000:00080000:2.0:1787827145.163169:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1787827145.163188:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1787827145.164272:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9449:x1874672580848640:12345-0@lo:5: Request processed in 4499us (4685us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787827145.164280:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787827145.164531:0:9449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8bbd356580 x1874672580848640/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.164556:0:9449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd356580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:9449:1874672580848640:0@lo:5: 00000004:00080000:0.0:1787827145.164594:0:9449:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:01000004:0.0:1787827145.285405:0:9476:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787827145.285409:0:9476:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787827145.285412:0:9476:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787827145.285584:0:9476:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f8a8571b000 00000020:01000004:0.0:1787827145.285599:0:9476:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787827145.285611:0:9476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787827145.285624:0:9476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f8bbac7b370) 00000020:00000080:0.0:1787827145.285639:0:9476:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787827145.303019:0:9476:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787827145.303072:0:9476:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1787827145.313634:0:9476:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787827145.313878:0:9476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787827145.313893:0:9476:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787827145.313905:0:9476:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb2e8bd65d71dd964 00000020:01000004:1.0:1787827145.313913:0:9476:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787827145.313934:0:9476:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787827145.313938:0:9476:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787827145.313943:0:9476:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787827145.313971:0:9476:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787827145.313975:0:9476:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787827145.324657:0:9476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787827145.324693:0:9476:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787827145.324697:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787827145.324699:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787827145.324700:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827145.324701:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827145.324703:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827145.324704:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827145.324705:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827145.324706:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827145.324708:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827145.324709:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827145.324711:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827145.324714:0:9476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787827145.324717:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787827145.324718:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787827145.324719:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827145.324720:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827145.324721:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827145.324722:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827145.324723:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827145.324724:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827145.324725:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827145.324727:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827145.324728:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787827145.324751:0:9476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787827145.324767:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd354f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580848768:0@lo:253: 00000100:00100000:0.0:1787827145.324861:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.324904:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9156c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.324931:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848768 00000100:00100000:2.0:1787827145.324938:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848768 00000100:00100000:2.0:1787827145.324987:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787827145.324996:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:9476:x1874672580848768:12345-0@lo:253: 20000000:01000000:2.0:1787827145.325033:0:6476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787827145.325037:0:6476:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787827145.325041:0:6476:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787827145.325044:0:6476:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787827145.325248:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827145.325351:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1787827145.325364:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787827145.325405:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1787827145.325415:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787827145.325428:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1787827145.325454:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787827145.325532:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787827145.325545:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787827145.325547:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787827145.325558:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787827145.325563:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787827145.325574:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787827145.325579:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787827145.325591:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787827145.325597:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787827145.325608:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787827145.325620:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787827145.325685:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1787827145.325695:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787827145.325697:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787827145.325709:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787827145.325714:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787827145.325724:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787827145.325728:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787827145.325738:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787827145.325742:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787827145.325752:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787827145.325763:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787827145.326110:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787827145.326121:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1787827145.326123:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787827145.326133:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787827145.326138:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787827145.326158:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787827145.326164:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1787827145.326187:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787827145.326194:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787827145.326206:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787827145.326220:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787827145.326232:0:6476:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787827145.326234:0:6476:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787827145.326237:0:6476:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787827145.326276:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787827145.326279:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787827145.327067:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1787827145.327094:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1787827145.327104:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787827145.327227:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787827145.327258:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1787827145.327285:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1787827145.327296:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787827145.327297:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787827145.327633:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787827145.327729:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787827145.327764:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787827145.327796:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1787827145.327808:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787827145.327810:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787827145.328009:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787827145.328023:0:9484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787827145.328042:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1787827145.328131:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1787827145.328144:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1787827145.328152:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1787827145.328158:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787827145.328159:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787827145.328308:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1787827145.328325:0:9485:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1787827145.328339:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1787827145.328413:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1787827145.328427:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1787827145.328436:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1787827145.328441:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787827145.328443:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787827145.328584:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787827145.328596:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787827145.328603:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787827145.328666:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787827145.328677:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787827145.328685:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:0.0:1787827145.328693:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787827145.328708:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328723:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328731:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328738:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328764:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328769:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328773:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328777:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328781:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328822:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.328832:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 21 pid: 6479 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.328842:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580848896:0@lo:104: 00000100:00100000:0.0:1787827145.328884:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.328919:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580848896 00010000:00010000:0.0:1787827145.328922:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.328925:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580848896 00010000:00010000:0.0:1787827145.328930:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.328939:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849024:0@lo:104: 00000100:00100000:3.0:1787827145.328971:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827145.328975:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.328990:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd355e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580848896:12345-0@lo:104: 00010000:00010000:3.0:1787827145.329001:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329008:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.329015:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849024 00000100:00100000:2.0:1787827145.329020:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849024 00010000:00010000:0.0:1787827145.329026:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 21 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329036:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd357c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849152:0@lo:104: 00000100:00100000:2.0:1787827145.329060:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787827145.329067:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849024:12345-0@lo:104: 00010000:00010000:2.0:1787827145.329074:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329079:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827145.329080:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787827145.329091:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd355e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580848896:12345-0@lo:104: Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.329100:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1787827145.329100:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787827145.329113:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1787827145.329115:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329123:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 21 pid: 6478 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329126:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787827145.329130:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849152 00000100:00100000:0.0:1787827145.329131:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849280:0@lo:104: 00000100:00100000:2.0:1787827145.329135:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd354000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849024:12345-0@lo:104: Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.329136:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849152 00000100:00100000:2.0:1787827145.329150:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787827145.329165:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787827145.329167:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.329176:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849280 00000100:00100000:3.0:1787827145.329177:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849152:12345-0@lo:104: 00000100:00100000:2.0:1787827145.329182:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849280 00010000:00010000:3.0:1787827145.329185:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329190:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329200:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 21 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329208:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849408:0@lo:104: 00000100:00100000:2.0:1787827145.329208:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787827145.329221:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86725e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849280:12345-0@lo:104: 00010000:00010000:3.0:1787827145.329230:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1787827145.329231:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.329241:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849152:12345-0@lo:104: Request processed in 65us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.329244:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.329251:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787827145.329262:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849408 00000100:00100000:1.0:1787827145.329267:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849408 00010000:00010000:3.0:1787827145.329269:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787827145.329271:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329275:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329279:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1787827145.329289:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329290:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031200 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:2.0:1787827145.329291:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86725e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849280:12345-0@lo:104: Request processed in 72us (126us total) trans 0 rc 0/0 10000000:00010000:3.0:1787827145.329297:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329306:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787827145.329310:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787827145.329313:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827145.329329:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329337:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849536:0@lo:104: 00000100:00100000:1.0:1787827145.329338:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 10000000:01000000:3.0:1787827145.329349:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827145.329354:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbceb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849408:12345-0@lo:104: 00010000:00010000:2.0:1787827145.329355:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787827145.329362:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.329367:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329368:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5f0a400 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827145.329374:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329441:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827145.329471:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787827145.329480:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbceb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849408:12345-0@lo:104: Request processed in 129us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.329488:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787827145.329489:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329499:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 21 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329506:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827145.329512:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329523:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849792:0@lo:104: 00010000:00010000:3.0:1787827145.329528:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329533:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849536 00010000:00010000:3.0:1787827145.329534:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80031200/0xb2e8bd65d71dd94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd956 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329540:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849536 00010000:00010000:3.0:1787827145.329546:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787827145.329551:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787827145.329553:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329562:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5d200 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:0.0:1787827145.329565:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145c00 going to sleep for 11 seconds 10000000:00010000:3.0:1787827145.329566:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329569:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849792 00000100:00100000:1.0:1787827145.329575:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849792 00010000:00010000:3.0:1787827145.329578:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827145.329586:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329587:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3570c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580848896:0@lo:104: 10000000:01000000:3.0:1787827145.329598:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827145.329607:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849024:0@lo:104: 00000100:00100000:1.0:1787827145.329611:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787827145.329619:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd357c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849152:0@lo:104: 00000100:00100000:1.0:1787827145.329624:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86726d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849536:12345-0@lo:104: 00010000:00010000:3.0:1787827145.329628:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329635:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849280:0@lo:104: 00010000:00010000:3.0:1787827145.329637:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827145.329641:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329649:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849408:0@lo:104: 00010000:00010000:3.0:1787827145.329663:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329668:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329672:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d200/0xb2e8bd65d71dd909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd910 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.329690:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:2.0:1787827145.329691:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329694:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787827145.329703:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86726d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6476:x1874672580849536:12345-0@lo:104: Request processed in 80us (327us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827145.329703:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.329704:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849536:0@lo:104: 10000000:01000000:2.0:1787827145.329706:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827145.329721:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787827145.329731:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329734:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80030c00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:3.0:1787827145.329739:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329740:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787827145.329750:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a867270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849792:12345-0@lo:104: 00010000:00010000:2.0:1787827145.329759:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787827145.329760:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.329764:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329769:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827145.329771:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329796:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a400/0xb2e8bd65d71dd925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd92c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827145.329800:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827145.329817:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787827145.329823:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329824:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.329832:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787827145.329842:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1874672580849792:0@lo:104: 00010000:00010000:2.0:1787827145.329842:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031600 already unused, calling callback (ffffffffc1503c20) 00010000:00010000:3.0:1787827145.329843:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787827145.329844:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a867270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6476:x1874672580849792:12345-0@lo:104: Request processed in 95us (294us total) trans 0 rc 0/0 10000000:00010000:2.0:1787827145.329850:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329855:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329858:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787827145.329860:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329872:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80030c00/0xb2e8bd65d71dd8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8e6 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827145.329874:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.329878:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827145.329891:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787827145.329892:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787827145.329901:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329906:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5f0aa00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:3.0:1787827145.329909:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329914:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827145.329918:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329920:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827145.329923:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827145.329930:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827145.329935:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329942:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80031600/0xb2e8bd65d71dd8c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8ca expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329950:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329955:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827145.329957:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827145.329960:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329963:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.329967:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0aa00/0xb2e8bd65d71dd884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd88b expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.329974:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031e00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827145.329978:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.329986:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580850176:0@lo:103: 00010000:00010000:2.0:1787827145.329994:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827145.330004:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330004:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827145.330009:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827145.330013:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787827145.330014:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827145.330024:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.330030:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580849920:0@lo:103: 00010000:00010000:2.0:1787827145.330034:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330039:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827145.330043:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330053:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:2.0:1787827145.330055:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80031e00/0xb2e8bd65d71dd85a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd861 expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330063:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580849664:0@lo:103: 00010000:00010000:2.0:1787827145.330066:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827145.330069:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827145.330070:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827145.330074:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827145.330098:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.330102:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850432:0@lo:103: 00000100:00100000:0.0:1787827145.330111:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850176 00000100:00100000:0.0:1787827145.330116:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850176 00000100:00100000:1.0:1787827145.330124:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580850304:0@lo:103: 00000100:00100000:2.0:1787827145.330127:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849920 00000100:00100000:2.0:1787827145.330133:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849920 00000100:00100000:3.0:1787827145.330139:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827145.330140:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 23 pid: 6478 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330154:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 23 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330161:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787827145.330164:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.330170:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850048:0@lo:103: 00000100:00100000:2.0:1787827145.330191:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580849664 00000100:00100000:0.0:1787827145.330194:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850432 00000100:00100000:2.0:1787827145.330196:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580849664 00000100:00100000:0.0:1787827145.330199:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850432 00000100:00100000:3.0:1787827145.330202:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827145.330216:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827145.330216:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 25 pid: 6479 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330219:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850560:0@lo:103: 00010000:00010000:0.0:1787827145.330221:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 25 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330239:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.330246:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850304 00000100:00100000:2.0:1787827145.330251:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850304 00000100:00100000:1.0:1787827145.330252:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850048 00000100:00100000:0.0:1787827145.330256:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850560 00000100:00100000:1.0:1787827145.330258:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850048 00000100:00100000:0.0:1787827145.330262:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850560 00010000:00010000:2.0:1787827145.330265:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 27 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330272:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787827145.330281:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 28 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330282:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3615:x1874672580850176:12345-0@lo:103: 00000100:00100000:2.0:1787827145.330286:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1787827145.330290:0:7425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 28 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330298:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787827145.330299:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3613:x1874672580849920:12345-0@lo:103: 00010000:00010000:3.0:1787827145.330309:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 28 pid: 6478 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330313:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787827145.330318:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787827145.330321:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 28 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330328:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 28 pid: 6478 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330335:0:7425:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1787827145.330336:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3615:x1874672580849664:12345-0@lo:103: 00010000:00010000:2.0:1787827145.330342:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 28 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330346:0:7425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:0.0:1787827145.330350:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827145.330359:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 28 pid: 6479 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330368:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0b800/0xb2e8bd65d71dd8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8df expref: 28 pid: 6478 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330371:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dd910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd909 expref: 28 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330375:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 28 pid: 6479 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330412:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827145.330413:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827145.330420:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71dd956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd94f expref: 26 pid: 6479 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330432:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827145.330458:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865acb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+25:3613:x1874672580849920:12345-0@lo:103: Request processed in 161us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.330467:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+25:3615:x1874672580850176:12345-0@lo:103: Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.330470:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827145.330478:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+25:3615:x1874672580849664:12345-0@lo:103: Request processed in 145us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.330484:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787827145.330494:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787827145.330496:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb888c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3613:x1874672580850432:12345-0@lo:103: 00000100:00100000:0.0:1787827145.330505:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787827145.330506:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827145.330514:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 23 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.330516:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787827145.330526:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787827145.330532:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 22 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.330532:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b929952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:3615:x1874672580850304:12345-0@lo:103: 00000100:00100000:0.0:1787827145.330533:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787827145.330537:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:3613:x1874672580850560:12345-0@lo:103: 00010000:00010000:2.0:1787827145.330550:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787827145.330551:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:3613:x1874672580850048:12345-0@lo:103: 00010000:00010000:3.0:1787827145.330552:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827145.330558:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8000/0xb2e8bd65d71dd88b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd884 expref: 22 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330561:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 22 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330561:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 22 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.330581:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827145.330583:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827145.330587:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 21 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330593:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330608:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb888c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:3613:x1874672580850432:12345-0@lo:103: Request processed in 115us (469us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827145.330610:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330627:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787827145.330631:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0ae00/0xb2e8bd65d71dd8ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8c3 expref: 21 pid: 6476 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330635:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 21 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330649:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827145.330650:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0a200/0xb2e8bd65d71dd861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd85a expref: 19 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330657:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dd92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd925 expref: 19 pid: 7426 timeout: 247 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330661:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330671:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.330677:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827145.330679:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b929952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3615:x1874672580850304:12345-0@lo:103: Request processed in 153us (520us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827145.330680:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.330691:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787827145.330693:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330699:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330704:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330707:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031a00 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:3.0:1787827145.330710:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.330719:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3613:x1874672580850048:12345-0@lo:103: Request processed in 170us (515us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827145.330719:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.330735:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787827145.330754:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85710f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580849664:0@lo:103: 00010000:00010000:3.0:1787827145.330754:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.330767:0:6476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.330770:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787827145.330773:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580850304:0@lo:103: 00010000:00010000:2.0:1787827145.330784:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.330806:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580850176:0@lo:103: 00000100:00100000:3.0:1787827145.330813:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865aed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3613:x1874672580850560:12345-0@lo:103: Request processed in 278us (573us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827145.330821:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b80031a00/0xb2e8bd65d71dd96b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.330825:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1787827145.330839:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787827145.330851:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850048:0@lo:103: 00000100:00100000:1.0:1787827145.330871:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850560:0@lo:103: 00000100:00100000:1.0:1787827145.330879:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580849920:0@lo:103: 00000100:00100000:1.0:1787827145.330887:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580850432:0@lo:103: 00000100:00100000:2.0:1787827145.332000:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:9476:x1874672580848768:12345-0@lo:253: Request processed in 7004us (7138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.332011:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787827145.332027:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd354f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580848768:0@lo:253: 10000000:01000000:0.0:1787827145.332039:0:9476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787827145.332042:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787827145.332043:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787827145.332044:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827145.332045:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787827145.332045:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787827145.332046:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827145.332047:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827145.332049:0:9476:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787827145.332050:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827145.332051:0:9476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787827145.332063:0:9476:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f8a8571b000 from lustre-OST0001 10000000:01000000:0.0:1787827145.332078:0:9476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787827145.332080:0:9476:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787827145.332086:0:9476:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f8b988b19b8 local copy 10000000:01000000:0.0:1787827145.332088:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787827145.332105:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332115:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332121:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.332130:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850688:0@lo:101: 00000100:00100000:0.0:1787827145.332152:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.332177:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145900 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.332194:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850688 00000100:00100000:1.0:1787827145.332199:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850688 00000100:00100000:1.0:1787827145.332228:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787827145.332237:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:9476:x1874672580850688:12345-0@lo:101: 00010000:00010000:1.0:1787827145.332247:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827145.332258:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5cc00/0xb2e8bd65d71dd979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd972 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.332271:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5cc00/0xb2e8bd65d71dd979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd972 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.332278:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5cc00/0xb2e8bd65d71dd979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd972 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827145.332283:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5cc00, rc 0) 00000100:00100000:1.0:1787827145.332308:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580850688:12345-0@lo:101: Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.332312:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787827145.332341:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850688:0@lo:101: 00010000:00010000:0.0:1787827145.332350:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332355:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.332484:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850816:0@lo:501: 00000100:00100000:0.0:1787827145.332516:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.332531:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145900 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.332541:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850816 00000100:00100000:1.0:1787827145.332547:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850816 00000100:00100000:1.0:1787827145.332577:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787827145.332585:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580850816:12345-0@lo:501: 00000100:00100000:1.0:1787827145.332644:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580850816:12345-0@lo:501: Request processed in 61us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827145.332658:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787827145.332662:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850816:0@lo:501: 10000000:01000000:0.0:1787827145.332673:0:9476:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787827145.332686:0:9476:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787827145.332689:0:9476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332695:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332703:0:9476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332715:0:9476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787827145.332730:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f8a8571b000 10000000:01000000:0.0:1787827145.332733:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787827145.332736:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787827145.332738:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787827145.332740:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1787827145.332741:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787827145.332745:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787827145.332749:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.332758:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80030400 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:3.0:1787827145.332762:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332767:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332777:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.332779:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.332802:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787827145.332804:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827145.332820:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827145.332827:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850944:0@lo:101: 00010000:00010000:3.0:1787827145.332842:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.332850:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787827145.332854:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.332869:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145b40 going to sleep for 11 seconds 00010000:00010000:3.0:1787827145.332876:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.332883:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580850944 00000100:00100000:2.0:1787827145.332887:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580850944 00010000:00010000:3.0:1787827145.332887:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80030400/0xb2e8bd65d71dd972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb2e8bd65d71dd979 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827145.332896:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580851072:0@lo:103: 00000100:00100000:2.0:1787827145.332915:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00010000:00010000:3.0:1787827145.332918:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827145.332923:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827145.332926:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580850944:12345-0@lo:101: 00010000:00010000:3.0:1787827145.332928:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827145.332935:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827145.332935:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.332946:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd980 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.332960:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851072 00010000:00010000:2.0:1787827145.332964:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 16 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.332966:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851072 00010000:00010000:2.0:1787827145.332978:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.332986:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474200, rc 0) 00000100:00100000:0.0:1787827145.333004:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827145.333014:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3615:x1874672580851072:12345-0@lo:103: 00010000:00010000:0.0:1787827145.333023:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787827145.333027:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580850944:12345-0@lo:101: Request processed in 103us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.333035:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00010000:0.0:1787827145.333037:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5cc00/0xb2e8bd65d71dd979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb2e8bd65d71dd972 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.333048:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580850944:0@lo:101: 00010000:00010000:0.0:1787827145.333058:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827145.333065:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.333075:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.333093:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3615:x1874672580851072:12345-0@lo:103: Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.333099:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787827145.333118:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580851072:0@lo:103: 00000100:00100000:3.0:1787827145.333161:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851200:0@lo:501: 00000100:00100000:3.0:1787827145.333192:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.333212:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913840 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.333231:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851200 00000100:00100000:2.0:1787827145.333236:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851200 00000100:00100000:2.0:1787827145.333261:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787827145.333273:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851200:12345-0@lo:501: 00000100:00100000:2.0:1787827145.333359:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851200:12345-0@lo:501: Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.333366:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787827145.333412:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851200:0@lo:501: 00000100:00100000:3.0:1787827145.333441:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851328:0@lo:503: 00000100:00100000:3.0:1787827145.333475:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.333501:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913840 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.333517:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851328 00000100:00100000:0.0:1787827145.333522:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851328 00000100:00100000:0.0:1787827145.333551:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787827145.333559:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851328:12345-0@lo:503: 00000100:00100000:0.0:1787827145.333636:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851328:12345-0@lo:503: Request processed in 78us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.333645:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787827145.333652:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851328:0@lo:503: 00000040:00080000:3.0:1787827145.333889:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827145.333956:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851456:0@lo:502: 00000100:00100000:3.0:1787827145.333989:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.334008:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913840 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.334021:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851456 00000100:00100000:1.0:1787827145.334026:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851456 00000100:00100000:1.0:1787827145.334051:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787827145.334055:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851456:12345-0@lo:502: 00000100:00100000:1.0:1787827145.334114:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851456:12345-0@lo:502: Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.334120:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787827145.334138:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851456:0@lo:502: 00000040:00080000:3.0:1787827145.334315:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787827145.334341:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787827145.334356:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787827145.334368:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787827145.334415:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787827145.334437:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787827145.334457:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851584:0@lo:502: 00000100:00100000:3.0:1787827145.334493:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.334513:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851584 00000100:00100000:2.0:1787827145.334518:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851584 00000100:00100000:3.0:1787827145.334519:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913840 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.334550:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787827145.334557:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851584:12345-0@lo:502: 00000100:00100000:2.0:1787827145.334624:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851584:12345-0@lo:502: Request processed in 66us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.334631:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787827145.334637:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851584:0@lo:502: 00000040:00080000:3.0:1787827145.334677:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787827145.334684:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1787827145.334946:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787827145.334953:0:9489:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787827145.334959:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.334961:0:9489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787827145.334966:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787827145.334985:0:9489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f8a867519b8) 00000020:00000080:3.0:1787827145.335006:0:9489:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787827145.335014:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787827145.335067:0:9489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a8571b000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787827145.335076:0:9489:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787827145.335082:0:9489:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb2e8bd65d71dd995 00010000:00010000:3.0:1787827145.337895:0:9489:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1787827145.338130:0:9489:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787827145.340018:0:9489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787827145.340223:0:9489:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787827145.342599:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787827145.342783:0:9489:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787827145.346893:0:9489:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1787827145.347687:0:9489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787827145.347697:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827145.347709:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.347711:0:9489:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787827145.347715:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827145.347720:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.347722:0:9489:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787827145.347727:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787827145.347729:0:9489:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787827145.347746:0:9489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827145.347749:0:9489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827145.347750:0:9489:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787827145.347754:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787827145.347846:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787827145.347882:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787827145.347901:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.347910:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827145.347916:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8a8571b000 from 1 10000000:01000000:0.0:1787827145.347919:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787827145.347947:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.347952:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.347961:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.347982:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851712:0@lo:101: 00000100:00100000:0.0:1787827145.348034:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.348065:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.348078:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851712 00000100:00100000:2.0:1787827145.348085:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851712 00000100:00100000:2.0:1787827145.348133:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787827145.348144:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:9476:x1874672580851712:12345-0@lo:101: 00010000:00010000:2.0:1787827145.348155:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.348168:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd99c expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.348200:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.348211:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.348220:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474600, rc 0) 00000100:00100000:2.0:1787827145.348268:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580851712:12345-0@lo:101: Request processed in 125us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.348286:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787827145.348318:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851712:0@lo:101: 00010000:00010000:0.0:1787827145.348334:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827145.348344:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.348463:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851840:0@lo:501: 00000100:00100000:0.0:1787827145.348494:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.348525:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.348537:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851840 00000100:00100000:2.0:1787827145.348542:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851840 00000100:00100000:2.0:1787827145.348578:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787827145.348586:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580851840:12345-0@lo:501: 00000100:00100000:2.0:1787827145.348661:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580851840:12345-0@lo:501: Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.348665:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787827145.348701:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851840:0@lo:501: 00000100:00100000:0.0:1787827145.348727:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851968:0@lo:503: 00000100:00100000:0.0:1787827145.349341:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.349359:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b86145f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.349373:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580851968 00000100:00100000:3.0:1787827145.349400:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580851968 00000100:00100000:3.0:1787827145.349428:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787827145.349434:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580851968:12345-0@lo:503: 00000100:00100000:3.0:1787827145.349527:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580851968:12345-0@lo:503: Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.349535:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787827145.349547:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580851968:0@lo:503: 00000040:00080000:2.0:1787827145.349749:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787827145.349807:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852096:0@lo:502: 00000100:00100000:2.0:1787827145.349836:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.349858:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.349868:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852096 00000100:00100000:3.0:1787827145.349873:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852096 00000100:00100000:3.0:1787827145.349903:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787827145.349912:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580852096:12345-0@lo:502: 00000100:00100000:3.0:1787827145.349988:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580852096:12345-0@lo:502: Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.349995:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787827145.350015:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852096:0@lo:502: 00000040:00080000:2.0:1787827145.350218:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787827145.350245:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787827145.350265:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852224:0@lo:502: 00000100:00100000:2.0:1787827145.350305:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.350324:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827145.350345:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852224 00000100:00100000:3.0:1787827145.350350:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852224 00000100:00100000:3.0:1787827145.350401:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787827145.350409:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580852224:12345-0@lo:502: 00000100:00100000:3.0:1787827145.350479:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580852224:12345-0@lo:502: Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.350493:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787827145.350498:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852224:0@lo:502: 00000040:00080000:2.0:1787827145.350538:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787827145.350547:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787827145.350830:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827145.350836:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827145.350838:0:9493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787827145.350842:0:9493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a8571b000 00000020:00000080:2.0:1787827145.350848:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787827145.350858:0:9493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827145.350860:0:9493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827145.350861:0:9493:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787827145.350863:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787827145.350903:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787827145.350936:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827145.350951:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.350962:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827145.351014:0:9476:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787827145.351018:0:9476:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f8a8571b000 10000000:01000000:3.0:1787827145.351021:0:9476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f8a8571b000 10000000:01000000:3.0:1787827145.351025:0:9476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787827145.351031:0:9476:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8a8571b000 from 1 10000000:01000000:3.0:1787827145.351033:0:9476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827145.351056:0:9476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.351062:0:9476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.351068:0:9476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.351077:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852352:0@lo:101: 00000100:00100000:3.0:1787827145.351100:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.351123:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852352 00000100:00100000:2.0:1787827145.351129:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852352 00000100:00100000:3.0:1787827145.351133:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.351167:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787827145.351174:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:9476:x1874672580852352:12345-0@lo:101: 00010000:00010000:2.0:1787827145.351181:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827145.351191:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dd9aa expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.351210:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.351220:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.351228:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81475e00, rc 0) 00000100:00100000:2.0:1787827145.351258:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852352:12345-0@lo:101: Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.351265:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787827145.351277:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852352:0@lo:101: 00010000:00010000:3.0:1787827145.351287:0:9476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.351300:0:9476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827145.351359:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852480:0@lo:501: 00000100:00100000:3.0:1787827145.351405:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.351427:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787827145.351447:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852480 00000100:00100000:1.0:1787827145.351454:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852480 00000100:00100000:1.0:1787827145.351486:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787827145.351495:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852480:12345-0@lo:501: 00000100:00100000:1.0:1787827145.351578:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852480:12345-0@lo:501: Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.351587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787827145.351603:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852480:0@lo:501: 00000100:00100000:3.0:1787827145.351625:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852608:0@lo:503: 00000100:00100000:3.0:1787827145.351652:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.351668:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.351682:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852608 00000100:00100000:2.0:1787827145.351686:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852608 00000100:00100000:2.0:1787827145.351715:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787827145.351719:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852608:12345-0@lo:503: 00000100:00100000:2.0:1787827145.351776:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852608:12345-0@lo:503: Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.351781:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787827145.351808:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852608:0@lo:503: 00000040:00080000:3.0:1787827145.351921:0:9476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787827145.351955:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852736:0@lo:502: 00000100:00100000:3.0:1787827145.351980:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.351994:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b835db600 going to sleep for 11 seconds 00000100:00100000:2.0:1787827145.352006:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852736 00000100:00100000:2.0:1787827145.352010:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852736 00000100:00100000:2.0:1787827145.352031:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787827145.352037:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852736:12345-0@lo:502: 00000100:00100000:2.0:1787827145.352109:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852736:12345-0@lo:502: Request processed in 71us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.352116:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787827145.352124:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852736:0@lo:502: 00000040:00080000:3.0:1787827145.352242:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787827145.352265:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787827145.352278:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787827145.352290:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787827145.352314:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787827145.352330:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787827145.352344:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787827145.352358:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787827145.352372:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787827145.352421:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787827145.352456:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787827145.352481:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787827145.352502:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787827145.352519:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787827145.352534:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787827145.352544:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787827145.352553:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787827145.352561:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787827145.352570:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787827145.352578:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787827145.352596:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787827145.352606:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787827145.352615:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787827145.352624:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787827145.352633:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787827145.352641:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787827145.352651:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787827145.352659:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787827145.352667:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787827145.352674:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787827145.352683:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787827145.352691:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787827145.352699:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787827145.352711:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787827145.352731:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787827145.352754:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787827145.352783:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1787827145.352812:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787827145.352826:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1787827145.352840:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1787827145.352853:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1787827145.352862:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1787827145.352873:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1787827145.352892:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1787827145.352901:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1787827145.352907:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1787827145.352924:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852864:0@lo:502: 00000100:00100000:3.0:1787827145.352956:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.352989:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.353000:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852864 00000100:00100000:0.0:1787827145.353007:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852864 00000100:00100000:0.0:1787827145.353043:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787827145.353053:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852864:12345-0@lo:502: 00000100:00100000:0.0:1787827145.353132:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580852864:12345-0@lo:502: Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.353139:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787827145.353150:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580852864:0@lo:502: 00000040:00080000:3.0:1787827145.353190:0:9476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1787827145.353199:0:9476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1787827145.353502:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787827145.353516:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f8a86754d28) 00000020:00000080:3.0:1787827145.353534:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1787827145.353604:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a8571b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787827145.353609:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8a8571b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787827145.353611:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8a8571b000 3 00010000:00080000:3.0:1787827145.353638:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a84df0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787827145.354782:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1787827145.354930:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787827145.354952:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787827145.354959:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb2e8bd65d71dd9bf 00000100:00080000:3.0:1787827145.354964:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827145.354967:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f8a84df0800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787827145.354987:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a865af0c0 x1874672580852992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787827145.355003:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787827145.355032:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1874672580852992:0@lo:38: 00000100:00100000:3.0:1787827145.355083:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580853120:0@lo:400: 00000100:00100000:1.0:1787827145.355093:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.355121:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.355150:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580853632:0@lo:400: 00000100:00100000:0.0:1787827145.355178:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580852992 00000100:00100000:1.0:1787827145.355178:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580853248:0@lo:400: 00000100:00100000:3.0:1787827145.355179:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.355197:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787827145.355200:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580852992 00000100:00100000:3.0:1787827145.355204:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580853504:0@lo:400: 00000100:00100000:1.0:1787827145.355220:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.355233:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853120 00000100:00100000:3.0:1787827145.355238:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.355239:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853120 00000100:00100000:1.0:1787827145.355248:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580853760:0@lo:400: 00000100:00100000:0.0:1787827145.355262:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853632 00000100:00100000:3.0:1787827145.355262:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580854016:0@lo:400: 00000100:00100000:0.0:1787827145.355268:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853632 00000100:00100000:0.0:1787827145.355292:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853504 00000100:00100000:0.0:1787827145.355295:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853504 00000100:00100000:1.0:1787827145.355303:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.355303:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.355316:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853760 00000100:00100000:0.0:1787827145.355320:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853760 00000100:00100000:2.0:1787827145.355330:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854016 00000100:00100000:2.0:1787827145.355335:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854016 00000100:00100000:1.0:1787827145.355338:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787827145.355350:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580853376:0@lo:400: 00000100:00100000:3.0:1787827145.355355:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787827145.355363:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787827145.355366:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580853120:12345-0@lo:400: 00000100:00100000:0.0:1787827145.355406:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580853632:12345-0@lo:400: 00000100:00100000:2.0:1787827145.355415:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787827145.355425:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672580854016:12345-0@lo:400: 00000100:00100000:1.0:1787827145.355432:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.355460:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580853888:0@lo:400: 00000100:00100000:3.0:1787827145.355484:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580853120:12345-0@lo:400: Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.355487:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580853632:12345-0@lo:400: Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.355492:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1874672580854016:12345-0@lo:400: Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827145.355501:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787827145.355507:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.355512:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787827145.355516:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787827145.355529:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787827145.355531:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853888 00000100:00100000:2.0:1787827145.355535:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853888 00000100:00100000:3.0:1787827145.355539:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580853504:12345-0@lo:400: 00000100:00100000:0.0:1787827145.355544:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787827145.355551:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853248 00000100:00100000:0.0:1787827145.355552:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1874672580852992:12345-0@lo:38: 00000100:00100000:1.0:1787827145.355558:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853248 00000100:00100000:2.0:1787827145.355562:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787827145.355574:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580853504:12345-0@lo:400: Request processed in 35us (337us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827145.355575:0:8120:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 98 last 0 00000100:00100000:2.0:1787827145.355580:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580853888:12345-0@lo:400: 00000100:00100000:3.0:1787827145.355583:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787827145.355601:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787827145.355603:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580853376 00000100:00100000:1.0:1787827145.355608:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580853376 00000100:00100000:3.0:1787827145.355609:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85712940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580853760:12345-0@lo:400: 00000020:00000080:0.0:1787827145.355614:0:8120:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb2e8bd65d71dd9c6 00000100:00100000:2.0:1787827145.355631:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580853888:12345-0@lo:400: Request processed in 60us (126us total) trans 0 rc 0/0 00000004:00100000:0.0:1787827145.355632:0:8120:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787827145.355637:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787827145.355643:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85712940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580853760:12345-0@lo:400: Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.355647:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787827145.355653:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85710f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580853248:12345-0@lo:400: 00000100:00100000:3.0:1787827145.355654:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787827145.355666:0:8120:0:(import.c:65:import_set_state_nolock()) ffff8f8a86729000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1787827145.355693:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a867243c0 x1874672580853888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787827145.355699:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a86724780 x1874672580853504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827145.355702:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787827145.355714:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580853504:0@lo:400: 00000100:00100000:2.0:1787827145.355719:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580853888:0@lo:400: 00000100:00100000:1.0:1787827145.355725:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85710f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580853248:12345-0@lo:400: Request processed in 73us (503us total) trans 0 rc 0/0 00010000:00080000:3.0:1787827145.355735:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a86725a40 x1874672580854016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827145.355737:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86726580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580853248:0@lo:400: 00000100:00100000:1.0:1787827145.355739:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787827145.355740:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b929970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3612:x1874672580852992:12345-0@lo:38: Request processed in 183us (645us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827145.355749:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a86724f00 x1874672580853760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827145.355762:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787827145.355763:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787827145.355771:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580854016:0@lo:400: 00000100:00100000:1.0:1787827145.355778:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85711680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580853376:12345-0@lo:400: 00000100:00100000:2.0:1787827145.355779:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580853760:0@lo:400: 00010000:00080000:3.0:1787827145.355802:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a867252c0 x1874672580853632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.355813:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580853632:0@lo:400: 00010000:00080000:3.0:1787827145.355830:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a86724b40 x1874672580853120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827145.355839:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580853120:0@lo:400: 00000100:00100000:1.0:1787827145.355846:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85711680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580853376:12345-0@lo:400: Request processed in 70us (412us total) trans 0 rc 0/0 00010000:00080000:0.0:1787827145.355851:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a865af0c0 x1874672580852992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.355856:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787827145.355867:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787827145.355873:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787827145.355881:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787827145.355903:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787827145.355906:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8a84df0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787827145.355915:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1874672580852992:0@lo:38: 00000020:01000004:3.0:1787827145.355949:0:9494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787827145.355961:0:9494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f8a86750000) 00000100:00100000:1.0:1787827145.355968:0:9495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9495:1874672580854144:0@lo:901: 00000020:00000080:3.0:1787827145.355976:0:9494:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:1.0:1787827145.356005:0:9495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.356031:0:9495:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8baa9146c0 going to sleep for 11 seconds 00000020:01000004:3.0:1787827145.356051:0:9494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f8a8571b000 from lustre-OST0001, refs=3 00000100:00100000:0.0:1787827145.356053:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854144 00000020:01000004:3.0:1787827145.356055:0:9494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f8a8571b000 from lustre-OST0001, refs=3 00000100:00100000:0.0:1787827145.356058:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854144 00000020:01000004:3.0:1787827145.356058:0:9494:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f8a8571b000 3 00010000:00080000:3.0:1787827145.356092:0:9494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8a87338000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.129@tcp at head 00000100:00080000:1.0:1787827145.356098:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827145.356101:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827145.356109:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9495:x1874672580854144:12345-0@lo:901: 00000100:00100000:0.0:1787827145.356174:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9495:x1874672580854144:12345-0@lo:901: Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.356179:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787827145.356204:0:9495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a85713840 x1874672580854144/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787827161 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.356215:0:9495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a85713840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9495:1874672580854144:0@lo:901: 00000100:00100000:0.0:1787827145.356469:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580853376:0@lo:400: 00010000:00010000:3.0:1787827145.358217:0:9494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1787827145.358432:0:9494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1787827145.358466:0:9494:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787827145.358476:0:9494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb2e8bd65d71dd9d4 00000100:00080000:3.0:1787827145.358484:0:9494:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787827145.358489:0:9494:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f8a87338000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787827145.358515:0:9494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8a865acf00 x1874672580854272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787827145.358537:0:9494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787827145.358595:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1874672580854272:0@lo:38: 00000100:00100000:0.0:1787827145.358648:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.358703:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854272 00000100:00100000:0.0:1787827145.358708:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854272 00000040:00080000:3.0:1787827145.358722:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1787827145.358734:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827145.358740:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1874672580854272:12345-0@lo:38: 00010000:00080000:0.0:1787827145.358757:0:6486:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 98 last 0 00000020:00000080:0.0:1787827145.358809:0:6486:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb2e8bd65d71dd9db 00000004:00100000:0.0:1787827145.358823:0:6486:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787827145.358849:0:6486:0:(import.c:65:import_set_state_nolock()) ffff8f8a8672d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827145.358896:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3612:x1874672580854272:12345-0@lo:38: Request processed in 154us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.358904:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787827145.358933:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f8a865acf00 x1874672580854272/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787827155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827145.358948:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787827145.358955:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787827145.358961:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787827145.358964:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787827145.358967:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8a87338000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787827145.358972:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1874672580854272:0@lo:38: 00000020:01000000:3.0:1787827145.359442:0:9476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1787827145.359482:0:9476:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787827145.359502:0:9476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827145.359513:0:9476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787827145.359556:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787827145.359558:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787827145.359559:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827145.359561:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827145.359562:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827145.359564:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827145.359565:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827145.359567:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787827145.359568:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787827145.359570:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827145.359571:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787827145.359574:0:9476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787827145.359577:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787827145.359579:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787827145.359580:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787827145.359582:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787827145.359583:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787827145.359584:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787827145.359585:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787827145.359587:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787827145.359587:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787827145.359589:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787827145.359589:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787827145.359602:0:9476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787827145.359612:0:9476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580854400:0@lo:253: 00000100:00100000:3.0:1787827145.359649:0:9476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827145.359681:0:9476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b828a3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.359697:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854400 00000100:00100000:0.0:1787827145.359703:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854400 00000100:00100000:0.0:1787827145.359737:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787827145.359743:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580854400:12345-0@lo:253: 20000000:01000000:0.0:1787827145.359759:0:6479:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787827145.359769:0:6479:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787827145.362319:0:6479:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787827145.362340:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787827145.362360:0:6500:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787827145.362366:0:6500:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787827145.362401:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362416:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362425:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362433:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362466:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362477:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 17 pid: 6478 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.362486:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580854528:0@lo:104: 00000100:00100000:2.0:1787827145.362528:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827145.362584:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 17 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.362587:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:9476:x1874672580854400:12345-0@lo:253: Request processed in 2841us (2935us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827145.362594:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 17 pid: 7426 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827145.362600:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787827145.362603:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580854656:0@lo:104: 00000100:00100000:2.0:1787827145.362636:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.362656:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a866e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1787827145.362660:0:9476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ac3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a7d14451-881f-46a5-81e7-5eca8cfcf000:9476:1874672580854400:0@lo:253: 10000000:01000000:0.0:1787827145.362670:0:9476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000100:00100000:2.0:1787827145.362673:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854528 00000020:01000004:0.0:1787827145.362674:0:9476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787827145.362676:0:9476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787827145.362678:0:9476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787827145.362679:0:9476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787827145.362680:0:9476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1787827145.362680:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854528 00000020:01000004:0.0:1787827145.362684:0:9476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787827145.362685:0:9476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787827145.362687:0:9476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787827145.362688:0:9476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787827145.362689:0:9476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787827145.362690:0:9476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787827145.362703:0:9476:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787827145.362717:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854656 00000100:00100000:2.0:1787827145.362720:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854656 00000100:00100000:2.0:1787827145.362739:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787827145.362747:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580854528:12345-0@lo:104: 00010000:00010000:2.0:1787827145.362755:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362810:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787827145.362817:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:6500:x1874672580854528:12345-0@lo:104: Request processed in 72us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.362823:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787827145.362837:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787827145.362843:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580854656:12345-0@lo:104: 00010000:00010000:2.0:1787827145.362848:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362880:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787827145.362885:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:6500:x1874672580854656:12345-0@lo:104: Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.362891:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787827145.362922:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787827145.362928:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362936:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5f0b200 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827145.362945:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.362954:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827145.362961:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827145.362968:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827145.362997:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363002:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827145.363017:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363022:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0b200/0xb2e8bd65d71dd917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd91e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363033:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787827145.363036:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363040:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80030a00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827145.363042:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363046:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827145.363058:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827145.363061:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827145.363072:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363076:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827145.363086:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363090:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80030a00/0xb2e8bd65d71dd8d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd8d8 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363102:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827145.363103:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827145.363105:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827145.363110:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827145.363119:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580854784:0@lo:103: 00000100:00100000:2.0:1787827145.363147:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.363181:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827145.363190:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580854912:0@lo:103: 00000100:00100000:2.0:1787827145.363212:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827145.363238:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854784 00000100:00100000:2.0:1787827145.363241:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854784 00010000:00010000:2.0:1787827145.363256:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 17 pid: 6478 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.363272:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580854912 00000100:00100000:2.0:1787827145.363279:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580854912 00010000:00010000:2.0:1787827145.363288:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 18 pid: 7426 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.363305:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787827145.363310:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3616:x1874672580854784:12345-0@lo:103: 00010000:00010000:2.0:1787827145.363318:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827145.363321:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 18 pid: 6478 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363330:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 18 pid: 6478 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363345:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827145.363407:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3616:x1874672580854784:12345-0@lo:103: Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.363415:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787827145.363436:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787827145.363445:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3614:x1874672580854912:12345-0@lo:103: 00010000:00010000:2.0:1787827145.363453:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827145.363458:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 17 pid: 7426 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363469:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 17 pid: 7426 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363481:0:9488:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363488:0:9488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787827145.363506:0:9488:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001140746s 00010000:00010000:2.0:1787827145.363510:0:9488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363518:0:9488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363525:0:9488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363532:0:9488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363539:0:9488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b81474000 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:2.0:1787827145.363543:0:9488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363548:0:9488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363557:0:9488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363565:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827145.363593:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3614:x1874672580854912:12345-0@lo:103: Request processed in 151us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827145.363599:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787827145.363635:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580854912:0@lo:103: 00000100:00100000:2.0:1787827145.363654:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580854784:0@lo:103: 00010000:00010000:2.0:1787827145.363684:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5dc00/0xb2e8bd65d71dd91e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd917 expref: 16 pid: 6478 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.363693:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580854528:0@lo:104: 00010000:00010000:2.0:1787827145.363702:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bb5f0a800/0xb2e8bd65d71dd8d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd8d1 expref: 15 pid: 7426 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827145.363710:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6500:1874672580854656:0@lo:104: 00010000:00010000:2.0:1787827145.363719:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363726:0:6500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363729:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827145.363733:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1787827145.366827:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787827145.366992:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787827145.367226:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787827145.367510:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787827145.367781:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787827145.368015:0:9476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787827145.368691:0:9476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787827145.370725:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787827145.374684:0:9476:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787827145.374693:0:9476:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787827145.374741:0:9476:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787827145.374776:0:9476:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787827145.374810:0:9476:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787827145.374830:0:9476:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787827145.375756:0:9476:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827145.375981:0:9476:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1787827145.622527:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580855168:0@lo:41: 00000100:00100000:2.0:1787827145.622544:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855040:0@lo:41: 00000100:00100000:1.0:1787827145.622604:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827145.622651:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855168 00000100:00100000:0.0:1787827145.622658:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855168 00000100:00100000:0.0:1787827145.622697:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787827145.622704:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580855168:12345-0@lo:41: 00000004:00000024:0.0:1787827145.622732:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1787827145.622769:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580855168:12345-0@lo:41: Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827145.622776:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787827145.622813:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580855168:0@lo:41: 00000100:00100000:2.0:1787827145.622841:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827145.622863:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855040 00000100:00100000:1.0:1787827145.622867:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855040 00000100:00100000:1.0:1787827145.622893:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787827145.622898:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580855040:12345-0@lo:41: 00000004:00000024:1.0:1787827145.622920:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787827145.622964:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580855040:12345-0@lo:41: Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827145.622971:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787827145.623006:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855040:0@lo:41: 00000020:00000004:1.0:1787827145.718525:0:9551:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827145.718767:0:9551:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787827146.391518:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827147.395482:0:9840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787827147.414498:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827147.708719:0:9892:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827147.708887:0:9892:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1787827148.015075:0:8396:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787827148.438544:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787827149.346197:0:9994:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827149.346474:0:9994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787827149.462485:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827149.691455:0:10042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827149.691468:0:10042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1787827149.835272:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.835410:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572432512 00000100:00100000:3.0:1787827149.835417:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572432512 00000100:00100000:3.0:1787827149.835451:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:3.0:1787827149.835458:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2393:x1874672572432512:12345-192.168.203.29@tcp:250: 00010000:00080000:3.0:1787827149.835484:0:7426:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0bb8b105-f59c-455a-b6b1-ce40efc3999c@192.168.203.29@tcp t0 exp 0000000000000000 cur 102 last 0 00000020:00000080:3.0:1787827149.835509:0:7426:0:(genops.c:1385:class_connect()) connect: client 0bb8b105-f59c-455a-b6b1-ce40efc3999c, cookie 0xb2e8bd65d71dd9e9 00000100:00080000:3.0:1787827149.835624:0:7426:0:(import.c:65:import_set_state_nolock()) ffff8f8a8733f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787827149.835676:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+5:2393:x1874672572432512:12345-192.168.203.29@tcp:250: Request processed in 218us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.835684:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:3.0:1787827149.836316:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.836354:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572432640 00000100:00100000:2.0:1787827149.836359:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572432640 00000100:00100000:2.0:1787827149.836410:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:2.0:1787827149.836418:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+5:6141:x1874672572432640:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1787827149.836427:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827149.836441:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba13469614 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.836458:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.836465:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.836471:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474800, rc 0) 00000100:00100000:2.0:1787827149.836500:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+6:6141:x1874672572432640:12345-192.168.203.29@tcp:101: Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.836506:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:1.0:1787827149.837155:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.837190:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572432768 00000100:00100000:3.0:1787827149.837195:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572432768 00000100:00100000:3.0:1787827149.837228:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:3.0:1787827149.837237:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+6:6141:x1874672572432768:12345-192.168.203.29@tcp:501: 00000100:00100000:3.0:1787827149.837299:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+6:6141:x1874672572432768:12345-192.168.203.29@tcp:501: Request processed in 65us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787827149.837304:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:0.0:1787827149.838070:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.838105:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572432896 00000100:00100000:3.0:1787827149.838110:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572432896 00000100:00100000:3.0:1787827149.838142:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1787827149.838155:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+6:6141:x1874672572432896:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1787827149.838164:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827149.838175:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba1346961b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.838232:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.838242:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.838250:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9600, rc 0) 00000100:00100000:3.0:1787827149.838289:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+7:6141:x1874672572432896:12345-192.168.203.29@tcp:101: Request processed in 140us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.838297:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:0.0:1787827149.839663:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.839712:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433024 00000100:00100000:2.0:1787827149.839719:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433024 00000100:00100000:2.0:1787827149.839769:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:2.0:1787827149.839778:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+7:6141:x1874672572433024:12345-192.168.203.29@tcp:501: 00000100:00100000:2.0:1787827149.839902:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6141:x1874672572433024:12345-192.168.203.29@tcp:501: Request processed in 125us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.839910:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1787827149.840743:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.840801:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433152 00000100:00100000:2.0:1787827149.840806:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433152 00000100:00100000:2.0:1787827149.840852:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:2.0:1787827149.840861:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6141:x1874672572433152:12345-192.168.203.29@tcp:503: 00000100:00100000:2.0:1787827149.840958:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6141:x1874672572433152:12345-192.168.203.29@tcp:503: Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.840966:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:0.0:1787827149.843317:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.843358:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433280 00000100:00100000:3.0:1787827149.843366:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433280 00000100:00100000:3.0:1787827149.843427:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:3.0:1787827149.843437:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6160:x1874672572433280:12345-192.168.203.29@tcp:502: 00000100:00100000:3.0:1787827149.843564:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6160:x1874672572433280:12345-192.168.203.29@tcp:502: Request processed in 127us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.843571:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:0.0:1787827149.855440:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.855514:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433408 00000100:00100000:2.0:1787827149.855526:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433408 00000100:00100000:2.0:1787827149.855574:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:2.0:1787827149.855581:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6160:x1874672572433408:12345-192.168.203.29@tcp:502: 00000100:00100000:2.0:1787827149.855719:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6160:x1874672572433408:12345-192.168.203.29@tcp:502: Request processed in 138us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.855725:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:1.0:1787827149.857783:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.857833:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433536 00000100:00100000:2.0:1787827149.857838:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433536 00000100:00100000:2.0:1787827149.857869:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:2.0:1787827149.857875:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6141:x1874672572433536:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1787827149.857885:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827149.857912:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba1346964c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.857937:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346964c expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.857949:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474000/0xb2e8bd65d71dd9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346964c expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827149.857958:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474000, rc 0) 00000100:00100000:2.0:1787827149.858027:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6141:x1874672572433536:12345-192.168.203.29@tcp:101: Request processed in 151us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.858034:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:0.0:1787827149.860197:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.860245:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433664 00000100:00100000:3.0:1787827149.860252:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433664 00000100:00100000:3.0:1787827149.860296:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:3.0:1787827149.860312:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6141:x1874672572433664:12345-192.168.203.29@tcp:256: 20000000:01000000:3.0:1787827149.860329:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787827149.860350:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787827149.860354:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787827149.860357:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787827149.860369:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787827149.860399:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787827149.861420:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6141:x1874672572433664:12345-192.168.203.29@tcp:256: Request processed in 1108us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.861429:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:1.0:1787827149.862997:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.863048:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433792 00000100:00100000:3.0:1787827149.863054:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433792 00000100:00100000:3.0:1787827149.863092:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:3.0:1787827149.863098:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6141:x1874672572433792:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1787827149.863108:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827149.863120:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba13469653 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.863142:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.863149:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827149.863155:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8e00, rc 0) 00000100:00100000:3.0:1787827149.863180:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6141:x1874672572433792:12345-192.168.203.29@tcp:101: Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.863186:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:0.0:1787827149.864306:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.864437:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572433920 00000100:00100000:2.0:1787827149.864443:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572433920 00000100:00100000:2.0:1787827149.864486:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:2.0:1787827149.864496:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6141:x1874672572433920:12345-192.168.203.29@tcp:501: 00000100:00100000:2.0:1787827149.864606:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6141:x1874672572433920:12345-192.168.203.29@tcp:501: Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.864613:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:0.0:1787827149.865425:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.865468:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434048 00000100:00100000:3.0:1787827149.865473:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434048 00000100:00100000:3.0:1787827149.865507:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:3.0:1787827149.865515:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6141:x1874672572434048:12345-192.168.203.29@tcp:503: 00000100:00100000:3.0:1787827149.865590:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6141:x1874672572434048:12345-192.168.203.29@tcp:503: Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.865602:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:1.0:1787827149.866520:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827149.866588:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434176 00000100:00100000:3.0:1787827149.866593:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434176 00000100:00100000:3.0:1787827149.866633:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:3.0:1787827149.866643:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6162:x1874672572434176:12345-192.168.203.29@tcp:502: 00000100:00100000:3.0:1787827149.866723:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6162:x1874672572434176:12345-192.168.203.29@tcp:502: Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827149.866730:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:0.0:1787827149.867697:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.867797:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434304 00000100:00100000:2.0:1787827149.867802:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434304 00000100:00100000:2.0:1787827149.867838:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:2.0:1787827149.867845:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6162:x1874672572434304:12345-192.168.203.29@tcp:502: 00000100:00100000:2.0:1787827149.867915:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6162:x1874672572434304:12345-192.168.203.29@tcp:502: Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.867921:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:0.0:1787827149.868989:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827149.869048:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434432 00000100:00100000:2.0:1787827149.869054:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434432 00000100:00100000:2.0:1787827149.869093:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787827149.869099:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86726940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1874672572434432:12345-192.168.203.29@tcp:38: 00010000:00080000:2.0:1787827149.869118:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8cef8de3-2326-42de-9d41-f4cb057ed6e8@192.168.203.29@tcp t0 exp 0000000000000000 cur 102 last 0 00000020:00000080:2.0:1787827149.869157:0:6485:0:(genops.c:1385:class_connect()) connect: client 8cef8de3-2326-42de-9d41-f4cb057ed6e8, cookie 0xb2e8bd65d71dda0c 00000004:00100000:2.0:1787827149.869227:0:6485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787827149.869266:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827149.869303:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434688 00000100:00100000:0.0:1787827149.869308:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434688 00000100:00100000:0.0:1787827149.869338:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787827149.869344:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1874672572434688:12345-192.168.203.29@tcp:38: 00010000:00080000:0.0:1787827149.869359:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8cef8de3-2326-42de-9d41-f4cb057ed6e8@192.168.203.29@tcp t0 exp 0000000000000000 cur 102 last 0 00000020:00000080:0.0:1787827149.869432:0:6484:0:(genops.c:1385:class_connect()) connect: client 8cef8de3-2326-42de-9d41-f4cb057ed6e8, cookie 0xb2e8bd65d71dda13 00000004:00100000:0.0:1787827149.869445:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787827149.869497:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8f8bbf9ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827149.869545:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86726940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2393:x1874672572434432:12345-192.168.203.29@tcp:38: Request processed in 444us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827149.869560:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00080000:0.0:1787827149.869626:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f8a8672d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787827149.869663:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2393:x1874672572434688:12345-192.168.203.29@tcp:38: Request processed in 318us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827149.869668:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1787827150.230520:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787827150.230546:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580855296:0@lo:13: 00000100:00100000:2.0:1787827150.230578:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827150.230592:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855424:0@lo:13: 00000100:00100000:1.0:1787827150.230618:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.230646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.230678:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855296 00000100:00100000:3.0:1787827150.230687:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855296 00000100:00100000:0.0:1787827150.230715:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855424 00000100:00100000:0.0:1787827150.230721:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855424 00000100:00080000:1.0:1787827150.230722:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827150.230744:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827150.230749:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827150.230775:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580855296:12345-0@lo:13: 00002000:00000024:3.0:1787827150.230803:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827150.230854:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580855296:12345-0@lo:13: Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.230862:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787827150.230882:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd355e00 x1874672580855296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827150.230883:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787827150.230894:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580855424:12345-0@lo:13: 00002000:00000024:3.0:1787827150.230909:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827150.230913:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580855296:0@lo:13: 00000100:00100000:3.0:1787827150.230948:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580855424:12345-0@lo:13: Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.230955:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787827150.230985:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a86727c00 x1874672580855424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.230994:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787827150.231021:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855424:0@lo:13: 00010000:00010000:3.0:1787827150.488943:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787827150.742577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580855808:0@lo:41: 00000100:00100000:1.0:1787827150.742582:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855552:0@lo:41: 00000100:00100000:3.0:1787827150.742613:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580855936:0@lo:400: 00000100:00100000:0.0:1787827150.742661:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827150.742663:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827150.742669:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580855680:0@lo:400: 00000100:00100000:1.0:1787827150.742722:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.742735:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580856320:0@lo:400: 00000100:00100000:1.0:1787827150.742774:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580856192:0@lo:400: 00000100:00100000:0.0:1787827150.742782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.742810:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580856832:0@lo:400: 00000100:00100000:2.0:1787827150.742810:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855680 00000100:00100000:2.0:1787827150.742818:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855680 00000100:00100000:1.0:1787827150.742819:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827150.742860:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580856704:0@lo:400: 00000100:00100000:2.0:1787827150.742871:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787827150.742881:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3615:x1874672580855680:12345-0@lo:400: 00000100:00100000:0.0:1787827150.742913:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827150.742938:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.742957:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855808 00000100:00100000:2.0:1787827150.742960:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3615:x1874672580855680:12345-0@lo:400: Request processed in 80us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.742963:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855808 00000100:00100000:2.0:1787827150.742972:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787827150.742992:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580856448:0@lo:400: 00000100:00100000:0.0:1787827150.742995:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856192 00000100:00100000:0.0:1787827150.743000:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856192 00000100:00100000:2.0:1787827150.743013:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856832 00000100:00100000:2.0:1787827150.743019:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856832 00000100:00100000:0.0:1787827150.743024:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787827150.743030:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.743038:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a867252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672580855808:12345-0@lo:41: 00000100:00100000:2.0:1787827150.743053:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856704 00000100:00100000:3.0:1787827150.743057:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580856960:0@lo:400: 00000100:00100000:2.0:1787827150.743059:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856704 00000004:00000024:0.0:1787827150.743065:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787827150.743089:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827150.743095:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.743099:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86724780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580856832:12345-0@lo:400: 00000100:00100000:0.0:1787827150.743122:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a867252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672580855808:12345-0@lo:41: Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.743123:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787827150.743134:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92a0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580856576:0@lo:400: 00000100:00100000:0.0:1787827150.743135:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787827150.743161:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787827150.743167:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86724780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580856832:12345-0@lo:400: Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.743168:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580855680:0@lo:400: 00000100:00100000:0.0:1787827150.743174:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580856192:12345-0@lo:400: 00000100:00100000:3.0:1787827150.743182:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.743184:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787827150.743207:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580857088:0@lo:400: 00000100:00100000:2.0:1787827150.743219:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787827150.743227:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827150.743232:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580856704:12345-0@lo:400: 00000100:00100000:0.0:1787827150.743233:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd355e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580856192:12345-0@lo:400: Request processed in 62us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.743246:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827150.743256:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580856064:0@lo:400: 00000100:00100000:0.0:1787827150.743257:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787827150.743277:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855552 00000100:00100000:0.0:1787827150.743283:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855552 00000100:00100000:3.0:1787827150.743289:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580855936 00000100:00100000:2.0:1787827150.743295:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580856704:12345-0@lo:400: Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.743296:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580855936 00000100:00100000:1.0:1787827150.743302:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827150.743307:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787827150.743309:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787827150.743319:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580855552:12345-0@lo:41: 00000100:00100000:3.0:1787827150.743329:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856320 00000100:00100000:3.0:1787827150.743334:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856320 00000004:00000024:0.0:1787827150.743339:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787827150.743341:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856064 00000100:00100000:1.0:1787827150.743347:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856064 00000100:00100000:2.0:1787827150.743355:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856448 00000100:00100000:3.0:1787827150.743357:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856960 00000100:00100000:2.0:1787827150.743360:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856448 00000100:00100000:3.0:1787827150.743363:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856960 00000100:00100000:0.0:1787827150.743404:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1874672580855552:12345-0@lo:41: Request processed in 87us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.743410:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787827150.743419:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787827150.743425:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580856576 00000100:00100000:3.0:1787827150.743430:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580856576 00000100:00100000:1.0:1787827150.743431:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580856064:12345-0@lo:400: 00000100:00100000:2.0:1787827150.743433:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857088 00000100:00100000:2.0:1787827150.743438:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857088 00010000:00080000:0.0:1787827150.743454:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0d2c0 x1874672580856832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827150.743465:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787827150.743470:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580856832:0@lo:400: 00000100:00100000:2.0:1787827150.743475:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787827150.743478:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580855936:12345-0@lo:400: 00000100:00100000:2.0:1787827150.743489:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86725a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580856320:12345-0@lo:400: 00000100:00100000:0.0:1787827150.743493:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580855808:0@lo:41: 00000100:00100000:1.0:1787827150.743499:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580856064:12345-0@lo:400: Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.743510:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787827150.743534:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787827150.743535:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0c780 x1874672580856704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827150.743538:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580855936:12345-0@lo:400: Request processed in 63us (876us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827150.743541:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827150.743557:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86725a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580856320:12345-0@lo:400: Request processed in 71us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.743558:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580856704:0@lo:400: 00000100:00100000:3.0:1787827150.743558:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787827150.743572:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787827150.743576:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86724b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580855552:0@lo:41: 00000100:00100000:0.0:1787827150.743582:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580856192:0@lo:400: 00000100:00100000:3.0:1787827150.743585:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787827150.743598:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787827150.743600:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580856960:12345-0@lo:400: 00000100:00100000:1.0:1787827150.743603:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580856064:0@lo:400: 00010000:00080000:0.0:1787827150.743622:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0f0c0 x1874672580856320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743627:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580856448:12345-0@lo:400: 00000100:00100000:0.0:1787827150.743643:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580856320:0@lo:400: 00000100:00100000:3.0:1787827150.743645:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580856960:12345-0@lo:400: Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.743652:0:8120:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787827150.743658:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787827150.743662:0:8120:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787827150.743680:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580856448:12345-0@lo:400: Request processed in 57us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.743680:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787827150.743693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787827150.743698:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580856576:12345-0@lo:400: 00000100:00100000:0.0:1787827150.743712:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787827150.743725:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580857088:12345-0@lo:400: 00000100:00100000:3.0:1787827150.743746:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580856576:12345-0@lo:400: Request processed in 50us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.743762:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787827150.743772:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0d680 x1874672580856576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743785:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580856576:0@lo:400: 00000100:00100000:0.0:1787827150.743792:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580857088:12345-0@lo:400: Request processed in 70us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.743809:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787827150.743809:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b9299f840 x1874672580857088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743822:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580857088:0@lo:400: 00010000:00080000:2.0:1787827150.743836:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0cf00 x1874672580856448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743857:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580856448:0@lo:400: 00010000:00080000:2.0:1787827150.743873:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92a0da40 x1874672580856960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743881:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92a0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580856960:0@lo:400: 00010000:00080000:2.0:1787827150.743891:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b867f2940 x1874672580855936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827150.743899:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580855936:0@lo:400: 00000100:00100000:1.0:1787827150.871805:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827150.871846:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827150.871886:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434944 00000100:00100000:1.0:1787827150.871887:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827150.871897:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434944 00000100:00100000:2.0:1787827150.871973:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434816 00000100:00100000:2.0:1787827150.871976:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434816 00000100:00100000:2.0:1787827150.871996:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572434560 00000100:00100000:2.0:1787827150.871999:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572434560 00000100:00100000:2.0:1787827150.872014:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1787827150.872024:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+7:6141:x1874672572434944:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1787827150.872053:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1787827150.872079:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787827150.872091:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:0:x1874672572434816:12345-192.168.203.29@tcp:41: 00000004:00000024:3.0:1787827150.872107:0:6486:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787827150.872117:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+7:6141:x1874672572434944:12345-192.168.203.29@tcp:41: Request processed in 92us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.872126:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787827150.872139:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:0:x1874672572434816:12345-192.168.203.29@tcp:41: Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.872146:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787827150.872226:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:0:x1874672572434560:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1787827150.872241:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787827150.872282:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:0:x1874672572434560:12345-192.168.203.29@tcp:41: Request processed in 59us (394us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827150.872334:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827150.872338:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827150.872473:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1787827150.872595:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1787827150.874515:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827150.874725:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435072 00000100:00100000:1.0:1787827150.874736:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435072 00000100:00100000:1.0:1787827150.874851:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787827150.874862:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435072:12345-192.168.203.29@tcp:40: 00000100:00100000:1.0:1787827150.874980:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435072:12345-192.168.203.29@tcp:40: Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827150.874989:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787827150.877001:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827150.877060:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435200 00000100:00100000:0.0:1787827150.877069:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435200 00000100:00100000:0.0:1787827150.877112:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787827150.877122:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1874672572435200:12345-192.168.203.29@tcp:8: 00010000:00080000:0.0:1787827150.877170:0:8400:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8cef8de3-2326-42de-9d41-f4cb057ed6e8@192.168.203.29@tcp t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:0.0:1787827150.877210:0:8400:0:(genops.c:1385:class_connect()) connect: client 8cef8de3-2326-42de-9d41-f4cb057ed6e8, cookie 0xb2e8bd65d71dda1a 00002000:00100000:0.0:1787827150.877224:0:8400:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8cef8de3-2326-42de-9d41-f4cb057ed6e8/ffff8f8a8672c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113941 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787827150.877237:0:8400:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787827150.877254:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827150.877294:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827150.877347:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435456 00000100:00100000:3.0:1787827150.877353:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435456 00000100:00100000:3.0:1787827150.877420:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787827150.877429:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435328 00000100:00100000:3.0:1787827150.877431:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a857112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435456:12345-192.168.203.29@tcp:900: 00000100:00100000:2.0:1787827150.877436:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435328 00000100:00100000:2.0:1787827150.877467:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787827150.877513:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a857112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435456:12345-192.168.203.29@tcp:900: Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.877523:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787827150.877584:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827150.877646:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1874672572435328:12345-192.168.203.29@tcp:8: 00002000:00080000:0.0:1787827150.877652:0:8400:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:2.0:1787827150.877679:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8cef8de3-2326-42de-9d41-f4cb057ed6e8@192.168.203.29@tcp t0 exp 0000000000000000 cur 103 last 0 00000100:00080000:0.0:1787827150.877694:0:8400:0:(import.c:65:import_set_state_nolock()) ffff8f8a86728000 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1787827150.877703:0:8402:0:(genops.c:1385:class_connect()) connect: client 8cef8de3-2326-42de-9d41-f4cb057ed6e8, cookie 0xb2e8bd65d71dda21 00002000:00100000:2.0:1787827150.877712:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cef8de3-2326-42de-9d41-f4cb057ed6e8/ffff8f8bbf9bd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113941 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787827150.877727:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787827150.877745:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2393:x1874672572435200:12345-192.168.203.29@tcp:8: Request processed in 622us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.877767:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787827150.878180:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435584 00000100:00100000:0.0:1787827150.878185:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435584 00000100:00100000:0.0:1787827150.878221:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:0.0:1787827150.878229:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2396:x1874672572435584:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1787827150.878273:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2396:x1874672572435584:12345-192.168.203.29@tcp:400: Request processed in 44us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827150.878278:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 153 00002000:00080000:2.0:1787827150.878372:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787827150.878415:0:8402:0:(import.c:65:import_set_state_nolock()) ffff8f8bbacab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827150.878440:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2393:x1874672572435328:12345-192.168.203.29@tcp:8: Request processed in 798us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.878448:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1787827150.879173:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827150.879264:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435712 00000100:00100000:3.0:1787827150.879269:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435712 00000100:00100000:3.0:1787827150.879299:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1787827150.879307:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a85713840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435712:12345-192.168.203.29@tcp:33: 00000004:00080000:3.0:1787827150.888817:0:6487:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9411us 00000004:00200000:2.0:1787827150.896409:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787827150.896562:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a85713840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6141:x1874672572435712:12345-192.168.203.29@tcp:33: Request processed in 17247us (17383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827150.896580:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1787827150.970030:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827150.970115:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435840 00000100:00100000:3.0:1787827150.970130:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435840 00000100:00100000:3.0:1787827150.970230:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1787827150.970243:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6180:x1874672572435840:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1787827150.970283:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827150.970317:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x218c3ba13469684 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970438:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9000/0xb2e8bd65d71dda2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970455:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9000/0xb2e8bd65d71dda2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970471:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9000/0xb2e8bd65d71dda2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787827150.970524:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787827150.970529:0:6486:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787827150.970546:0:6486:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9000/0xb2e8bd65d71dda2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970577:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469684 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970597:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f8bbcfa9000/0xb2e8bd65d71dda2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469684 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827150.970606:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f8b92a08800) 00010000:00010000:3.0:1787827150.970610:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787827150.970614:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9000, rc 0) 00000100:00100000:3.0:1787827150.970695:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+7:6180:x1874672572435840:12345-192.168.203.29@tcp:101: Request processed in 456us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827150.970710:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 10000000:01000000:1.0:1787827151.254493:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787827151.254501:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bb88cb000 from 39 10000000:01000000:1.0:1787827151.254508:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787827151.254565:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.254578:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.254588:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.254611:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857216:0@lo:101: 00000100:00100000:1.0:1787827151.254677:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.254726:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857216 00000100:00100000:1.0:1787827151.254727:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.254733:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857216 00000100:00100000:2.0:1787827151.254793:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787827151.254803:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580857216:12345-0@lo:101: 00010000:00010000:2.0:1787827151.254818:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827151.254831:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda36 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.254873:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.254881:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.254888:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474a00, rc 0) 00000100:00100000:2.0:1787827151.254926:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857216:12345-0@lo:101: Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.254931:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787827151.254975:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857216:0@lo:101: 00010000:00010000:1.0:1787827151.254991:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.255002:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.255058:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857344:0@lo:501: 00000100:00100000:1.0:1787827151.255081:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.255100:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.255130:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857344 00000100:00100000:0.0:1787827151.255136:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857344 00000100:00100000:0.0:1787827151.255167:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787827151.255184:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857344:12345-0@lo:501: 00000100:00100000:0.0:1787827151.255301:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857344:12345-0@lo:501: Request processed in 128us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.255307:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787827151.255335:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857344:0@lo:501: 00000100:00100000:1.0:1787827151.255370:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857472:0@lo:503: 00000100:00100000:1.0:1787827151.255420:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.255446:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.255475:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857472 00000100:00100000:0.0:1787827151.255480:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857472 00000100:00100000:0.0:1787827151.255513:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787827151.255520:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857472:12345-0@lo:503: 00000100:00100000:0.0:1787827151.255611:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857472:12345-0@lo:503: Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.255618:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787827151.255686:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857472:0@lo:503: 00000100:00100000:2.0:1787827151.256035:0:10056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10056:1874672580857600:0@lo:502: 00000100:00100000:2.0:1787827151.256071:0:10056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.256096:0:10056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.256155:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857600 00000100:00100000:3.0:1787827151.256159:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857600 00000100:00100000:3.0:1787827151.256190:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787827151.256197:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10056:x1874672580857600:12345-0@lo:502: 00000100:00100000:3.0:1787827151.256315:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10056:x1874672580857600:12345-0@lo:502: Request processed in 117us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.256337:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787827151.256349:0:10056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10056:1874672580857600:0@lo:502: 00000100:00100000:2.0:1787827151.256402:0:10056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10056:1874672580857728:0@lo:502: 00000100:00100000:2.0:1787827151.256427:0:10056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.256452:0:10056:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.256476:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857728 00000100:00100000:0.0:1787827151.256481:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857728 00000100:00100000:0.0:1787827151.256516:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787827151.256523:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10056:x1874672580857728:12345-0@lo:502: 00000100:00100000:0.0:1787827151.256605:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10056:x1874672580857728:12345-0@lo:502: Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.256612:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787827151.256637:0:10056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10056:1874672580857728:0@lo:502: 00000040:00080000:2.0:1787827151.256660:0:10056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787827151.256729:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787827151.256760:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787827151.256772:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.256783:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827151.256791:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787827151.256794:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787827151.256796:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787827151.256814:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.256822:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.256830:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.256840:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857856:0@lo:101: 00000100:00100000:1.0:1787827151.256864:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.256888:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.256916:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857856 00000100:00100000:0.0:1787827151.256921:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857856 00000100:00100000:0.0:1787827151.256947:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787827151.256954:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580857856:12345-0@lo:101: 00010000:00010000:0.0:1787827151.256963:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827151.256974:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda44 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.257002:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.257022:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 17 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.257030:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c0000, rc 0) 00000100:00100000:0.0:1787827151.257062:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580857856:12345-0@lo:101: Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.257068:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787827151.257091:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857856:0@lo:101: 00010000:00010000:1.0:1787827151.257102:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.257109:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.257152:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857984:0@lo:501: 00000100:00100000:1.0:1787827151.257171:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.257184:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.257209:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580857984 00000100:00100000:3.0:1787827151.257212:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580857984 00000100:00100000:3.0:1787827151.257232:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787827151.257242:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580857984:12345-0@lo:501: 00000100:00100000:3.0:1787827151.257317:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580857984:12345-0@lo:501: Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.257322:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787827151.257345:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580857984:0@lo:501: 00000100:00100000:1.0:1787827151.257363:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858112:0@lo:503: 00000100:00100000:1.0:1787827151.257413:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.257437:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.257477:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858112 00000100:00100000:3.0:1787827151.257482:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858112 00000100:00100000:3.0:1787827151.257507:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787827151.257514:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580858112:12345-0@lo:503: 00000100:00100000:3.0:1787827151.257591:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580858112:12345-0@lo:503: Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.257598:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787827151.257615:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858112:0@lo:503: 00000100:00100000:3.0:1787827151.257846:0:10057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10057:1874672580858240:0@lo:502: 00000100:00100000:3.0:1787827151.257874:0:10057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.257889:0:10057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98432780 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.257916:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858240 00000100:00100000:0.0:1787827151.257920:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858240 00000100:00100000:0.0:1787827151.257940:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787827151.257952:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10057:x1874672580858240:12345-0@lo:502: 00000100:00100000:0.0:1787827151.258052:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10057:x1874672580858240:12345-0@lo:502: Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.258059:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787827151.258155:0:10057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10057:1874672580858240:0@lo:502: 00000020:01000000:3.0:1787827151.258194:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827151.258201:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827151.258203:0:10057:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787827151.258207:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787827151.258209:0:10057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787827151.258223:0:10057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10057:1874672580858368:0@lo:502: 00000100:00100000:3.0:1787827151.258253:0:10057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.258273:0:10057:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98432780 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.258293:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858368 00000100:00100000:0.0:1787827151.258297:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858368 00000100:00100000:0.0:1787827151.258323:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787827151.258329:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10057:x1874672580858368:12345-0@lo:502: 00000100:00100000:0.0:1787827151.258431:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10057:x1874672580858368:12345-0@lo:502: Request processed in 100us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.258439:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787827151.258450:0:10057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10057:1874672580858368:0@lo:502: 00000020:01000000:3.0:1787827151.258473:0:10057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827151.258478:0:10057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827151.258479:0:10057:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787827151.258482:0:10057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787827151.258555:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787827151.258574:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787827151.258581:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.258591:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827151.258599:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787827151.258601:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bba965800 from 39 10000000:01000000:1.0:1787827151.258603:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787827151.258620:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.258628:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.258636:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.258651:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858496:0@lo:101: 00000100:00100000:1.0:1787827151.258671:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.258693:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.258710:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858496 00000100:00100000:3.0:1787827151.258715:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858496 00000100:00100000:3.0:1787827151.258758:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787827151.258766:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580858496:12345-0@lo:101: 00010000:00010000:3.0:1787827151.258781:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827151.258796:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda52 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.258813:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.258822:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.258829:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9800, rc 0) 00000100:00100000:3.0:1787827151.258862:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580858496:12345-0@lo:101: Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.258876:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787827151.258886:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858496:0@lo:101: 00010000:00010000:1.0:1787827151.258900:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.258908:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.258948:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858624:0@lo:501: 00000100:00100000:1.0:1787827151.258973:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.259001:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.259012:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858624 00000100:00100000:3.0:1787827151.259018:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858624 00000100:00100000:3.0:1787827151.259043:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787827151.259050:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580858624:12345-0@lo:501: 00000100:00100000:3.0:1787827151.259129:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580858624:12345-0@lo:501: Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.259136:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787827151.259151:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858624:0@lo:501: 00000100:00100000:1.0:1787827151.259177:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858752:0@lo:503: 00000100:00100000:1.0:1787827151.259210:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.259228:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.259257:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858752 00000100:00100000:0.0:1787827151.259263:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858752 00000100:00100000:0.0:1787827151.259291:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787827151.259299:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580858752:12345-0@lo:503: 00000100:00100000:0.0:1787827151.259373:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580858752:12345-0@lo:503: Request processed in 74us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.259410:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580858752:0@lo:503: 00000100:00100000:0.0:1787827151.259412:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787827151.259698:0:10058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10058:1874672580858880:0@lo:502: 00000100:00100000:1.0:1787827151.259728:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.259757:0:10058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.259789:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580858880 00000100:00100000:0.0:1787827151.259794:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580858880 00000100:00100000:0.0:1787827151.259824:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787827151.259831:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10058:x1874672580858880:12345-0@lo:502: 00000100:00100000:0.0:1787827151.259905:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10058:x1874672580858880:12345-0@lo:502: Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.259913:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787827151.259927:0:10058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10058:1874672580858880:0@lo:502: 00000100:00100000:1.0:1787827151.259959:0:10058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10058:1874672580859008:0@lo:502: 00000100:00100000:1.0:1787827151.260000:0:10058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.260016:0:10058:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.260039:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859008 00000100:00100000:3.0:1787827151.260044:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859008 00000100:00100000:3.0:1787827151.260076:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787827151.260084:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10058:x1874672580859008:12345-0@lo:502: 00000100:00100000:3.0:1787827151.260181:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10058:x1874672580859008:12345-0@lo:502: Request processed in 97us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.260188:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787827151.260266:0:10058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10058:1874672580859008:0@lo:502: 00000040:00080000:1.0:1787827151.260285:0:10058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787827151.260373:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787827151.260422:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827151.260430:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.260439:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827151.260459:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787827151.260461:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8bba965800 from 6 10000000:01000000:2.0:1787827151.260463:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787827151.260501:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.260510:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.260518:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827151.260530:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859136:0@lo:101: 00000100:00100000:2.0:1787827151.260558:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.260583:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.260593:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859136 00000100:00100000:3.0:1787827151.260597:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859136 00000100:00100000:3.0:1787827151.260628:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787827151.260632:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580859136:12345-0@lo:101: 00010000:00010000:3.0:1787827151.260638:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827151.260647:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dda67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda60 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.260659:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dda67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda60 expref: 19 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.260674:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9400/0xb2e8bd65d71dda67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda60 expref: 19 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.260687:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9400, rc 0) 00000100:00100000:3.0:1787827151.260723:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580859136:12345-0@lo:101: Request processed in 89us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.260730:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787827151.260760:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859136:0@lo:101: 00010000:00010000:1.0:1787827151.260774:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.260783:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.260822:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859264:0@lo:256: 00000100:00100000:1.0:1787827151.260850:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.260867:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.260880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859264 00000100:00100000:3.0:1787827151.260885:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859264 00000100:00100000:3.0:1787827151.260912:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787827151.260916:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580859264:12345-0@lo:256: 20000000:01000000:3.0:1787827151.260925:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787827151.260938:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787827151.260940:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787827151.261045:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580859264:12345-0@lo:256: Request processed in 126us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.261052:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787827151.261057:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859264:0@lo:256: 10000000:01000000:1.0:1787827151.261103:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787827151.261109:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.261116:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b81475a00/0xb2e8bd65d71dda60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda67 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827151.261123:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1787827151.261125:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1787827151.261127:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1787827151.261140:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.261157:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.261164:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.261175:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859392:0@lo:101: 00000100:00100000:1.0:1787827151.261199:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.261215:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.261250:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859392 00000100:00100000:3.0:1787827151.261254:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859392 00000100:00100000:3.0:1787827151.261279:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787827151.261285:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580859392:12345-0@lo:101: 00010000:00010000:3.0:1787827151.261292:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827151.261301:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda6e expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.261310:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.261316:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.261327:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8200, rc 0) 00000100:00100000:3.0:1787827151.261352:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580859392:12345-0@lo:101: Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.261362:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787827151.261373:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859392:0@lo:101: 00010000:00010000:1.0:1787827151.261398:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.261404:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.261439:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859520:0@lo:501: 00000100:00100000:1.0:1787827151.261460:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.261483:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.261520:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859520 00000100:00100000:0.0:1787827151.261533:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859520 00000100:00100000:0.0:1787827151.261597:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787827151.261609:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580859520:12345-0@lo:501: 00000100:00100000:0.0:1787827151.261802:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580859520:12345-0@lo:501: Request processed in 195us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.261812:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787827151.261820:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859520:0@lo:501: 00000100:00100000:1.0:1787827151.261849:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859648:0@lo:503: 00000100:00100000:1.0:1787827151.261881:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.261898:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.261923:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859648 00000100:00100000:2.0:1787827151.261929:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859648 00000100:00100000:2.0:1787827151.261959:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787827151.261968:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580859648:12345-0@lo:503: 00000100:00100000:2.0:1787827151.262060:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580859648:12345-0@lo:503: Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.262069:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787827151.262083:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580859648:0@lo:503: 00000100:00100000:1.0:1787827151.262266:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10059:1874672580859776:0@lo:502: 00000100:00100000:1.0:1787827151.262296:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.262309:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.262329:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859776 00000100:00100000:3.0:1787827151.262335:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859776 00000100:00100000:3.0:1787827151.262367:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787827151.262374:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10059:x1874672580859776:12345-0@lo:502: 00000100:00100000:3.0:1787827151.262477:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10059:x1874672580859776:12345-0@lo:502: Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.262485:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787827151.262489:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10059:1874672580859776:0@lo:502: 00000020:01000000:1.0:1787827151.262521:0:10059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787827151.262527:0:10059:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787827151.262534:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827151.262536:0:10059:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787827151.262543:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787827151.262545:0:10059:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:1.0:1787827151.262566:0:10059:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787827151.262569:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787827151.262593:0:10059:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f8bbd5f4d28) 00000020:00000080:1.0:1787827151.262614:0:10059:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1787827151.262620:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787827151.262704:0:10059:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787827151.262710:0:10059:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787827151.262717:0:10059:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb2e8bd65d71dda83 00010000:00080000:1.0:1787827151.262744:0:10059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8bbfa1c800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787827151.262951:0:10059:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1787827151.263065:0:10059:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787827151.263074:0:10059:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787827151.263224:0:10059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827151.263310:0:10059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787827151.263475:0:10059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787827151.263577:0:10059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787827151.263796:0:10060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787827151.263801:0:10060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787827151.264204:0:10059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787827151.264212:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787827151.264237:0:10059:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787827151.264256:0:10059:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dda8a 00000100:00080000:1.0:1787827151.264262:0:10059:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787827151.264266:0:10059:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f8bbfa1c800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787827151.264286:0:10059:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b92b92d00 x1874672580859904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787827151.264306:0:10059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787827151.264344:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580859904:0@lo:8: 00000020:01000000:1.0:1787827151.264373:0:10059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827151.264409:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827151.264412:0:10059:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787827151.264417:0:10059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1787827151.264422:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1787827151.264424:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827151.264428:0:10059:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787827151.264432:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787827151.264434:0:10059:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787827151.264444:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580859904 00000100:00100000:2.0:1787827151.264451:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580859904 00000100:00100000:1.0:1787827151.264457:0:10059:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10059:1874672580860032:0@lo:502: 00000100:00100000:2.0:1787827151.264491:0:9452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787827151.264499:0:9452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86724f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3612:x1874672580859904:12345-0@lo:8: 00000100:00100000:1.0:1787827151.264507:0:10059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787827151.264527:0:9452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000100:00100000:1.0:1787827151.264531:0:10059:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.264541:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860032 00000100:00100000:0.0:1787827151.264545:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860032 00000020:00000080:2.0:1787827151.264565:0:9452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb2e8bd65d71dda91 00002000:00100000:2.0:1787827151.264578:0:9452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f8bbf982000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113941 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:0.0:1787827151.264579:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00002000:00080000:2.0:1787827151.264585:0:9452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1787827151.264589:0:9452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787827151.264594:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10059:x1874672580860032:12345-0@lo:502: 00002000:00100000:2.0:1787827151.264623:0:9452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787827151.264692:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10059:x1874672580860032:12345-0@lo:502: Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.264702:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787827151.264710:0:10059:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10059:1874672580860032:0@lo:502: 00002000:00080000:2.0:1787827151.264737:0:9452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000020:01000000:1.0:1787827151.264739:0:10059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827151.264756:0:10059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827151.264759:0:10059:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787827151.264763:0:10059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00080000:2.0:1787827151.264773:0:9452:0:(import.c:65:import_set_state_nolock()) ffff8f8bbf981000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827151.264825:0:9452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86724f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3612:x1874672580859904:12345-0@lo:8: Request processed in 324us (407us total) trans 0 rc 0/0 00000020:01000000:3.0:1787827151.264837:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00000100:00100000:2.0:1787827151.264842:0:9452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:3.0:1787827151.264867:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787827151.264877:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.264888:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827151.264898:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787827151.264901:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8b98781000 from 39 10000000:01000000:3.0:1787827151.264903:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827151.264925:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.264932:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827151.264952:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827151.264963:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860160:0@lo:101: 00000100:00100000:3.0:1787827151.264992:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.265018:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913900 going to sleep for 11 seconds 00010000:00080000:0.0:1787827151.265071:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92b92d00 x1874672580859904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827151.265092:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787827151.265098:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787827151.265105:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787827151.265109:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787827151.265123:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8bbfa1c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787827151.265138:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787827151.265142:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1874672580859904:0@lo:8: 00000004:00080000:1.0:1787827151.265158:0:10060:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787827151.265195:0:10060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 103914815756ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787827151.265204:0:10060:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787827151.265205:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860160 00000100:00100000:2.0:1787827151.265211:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860160 00000100:00100000:2.0:1787827151.265240:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787827151.265246:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580860160:12345-0@lo:101: 00010000:00010000:2.0:1787827151.265253:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827151.265263:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71dda98 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.265279:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.265286:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.265293:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81475c00, rc 0) 00000100:00100000:2.0:1787827151.265320:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580860160:12345-0@lo:101: Request processed in 75us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.265325:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787827151.265340:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860160:0@lo:101: 00010000:00010000:1.0:1787827151.265356:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.265396:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.265456:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860288:0@lo:501: 00000100:00100000:3.0:1787827151.265481:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580860416:0@lo:700: 00000100:00100000:1.0:1787827151.265493:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.265511:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.265525:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860288 00000100:00100000:1.0:1787827151.265528:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860288 00000100:00100000:3.0:1787827151.265534:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.265558:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787827151.265561:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf9139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.265569:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580860288:12345-0@lo:501: 00000100:00100000:2.0:1787827151.265624:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860416 00000100:00100000:2.0:1787827151.265630:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860416 00000100:00100000:1.0:1787827151.265671:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580860288:12345-0@lo:501: Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.265678:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787827151.265679:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827151.265685:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787827151.265699:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10061:x1874672580860416:12345-0@lo:700: 00000100:00100000:2.0:1787827151.265729:0:8410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8410:1874672580860544:0@lo:700: 00000100:00100000:2.0:1787827151.265772:0:8410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.265794:0:8410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b9900b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.265826:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860544 00000100:00100000:0.0:1787827151.265830:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860544 00000100:00100000:3.0:1787827151.265866:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860288:0@lo:501: 00000100:00100000:0.0:1787827151.265877:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827151.265885:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b9299cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8410:x1874672580860544:12345-0@lo:700: 00000100:00100000:3.0:1787827151.265902:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860672:0@lo:503: 00000100:00100000:3.0:1787827151.265944:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.265979:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860672 00000100:00100000:1.0:1787827151.265984:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860672 00000100:00100000:3.0:1787827151.265985:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.266021:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787827151.266028:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580860672:12345-0@lo:503: 00000100:00100000:1.0:1787827151.266113:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580860672:12345-0@lo:503: Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.266120:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787827151.266165:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580860672:0@lo:503: 00000100:00100000:1.0:1787827151.266906:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10062:1874672580860800:0@lo:502: 00000100:00100000:1.0:1787827151.266946:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.266971:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40bd80 going to sleep for 11 seconds 00000001:00100000:2.0:1787827151.267159:0:6463:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cef8de3-2326-42de-9d41-f4cb057ed6e8 40000000:02000000:3.0:1787827151.267207:0:6491:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1787827151.267416:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860800 00000100:00100000:0.0:1787827151.267422:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860800 00000100:00100000:0.0:1787827151.267451:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787827151.267458:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10062:x1874672580860800:12345-0@lo:502: 00000004:00080000:1.0:1787827151.267554:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787827151.267580:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10062:x1874672580860800:12345-0@lo:502: Request processed in 120us (631us total) trans 0 rc 0/0 00000001:00100000:1.0:1787827151.267581:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8cef8de3-2326-42de-9d41-f4cb057ed6e8 00000100:00100000:0.0:1787827151.267596:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787827151.267602:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10062:1874672580860800:0@lo:502: 00000100:00100000:2.0:1787827151.267650:0:10062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10062:1874672580860928:0@lo:502: 00000100:00100000:2.0:1787827151.267682:0:10062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.267701:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580860928 00000100:00100000:2.0:1787827151.267704:0:10062:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b864310c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.267705:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580860928 00000100:00100000:1.0:1787827151.267734:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787827151.267740:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10062:x1874672580860928:12345-0@lo:502: 00000100:00100000:1.0:1787827151.267820:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10062:x1874672580860928:12345-0@lo:502: Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.267827:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787827151.267846:0:10062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10062:1874672580860928:0@lo:502: 00000040:00080000:2.0:1787827151.267864:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1787827151.267908:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1787827151.267934:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787827151.267943:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.267953:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827151.267961:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787827151.267963:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f8b98781000 from 6 10000000:01000000:1.0:1787827151.267966:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787827151.268000:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268012:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268020:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.268031:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861056:0@lo:101: 00000100:00100000:1.0:1787827151.268055:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.268080:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.268098:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861056 00000100:00100000:2.0:1787827151.268103:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861056 00000100:00100000:2.0:1787827151.268138:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787827151.268145:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580861056:12345-0@lo:101: 00010000:00010000:2.0:1787827151.268153:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827151.268165:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b81474c00/0xb2e8bd65d71ddaad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddaa6 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.268184:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b81474c00/0xb2e8bd65d71ddaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddaa6 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.268194:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b81474c00/0xb2e8bd65d71ddaad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddaa6 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.268213:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b81474c00, rc 0) 00000100:00100000:2.0:1787827151.268248:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580861056:12345-0@lo:101: Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.268254:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787827151.268280:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861056:0@lo:101: 00010000:00010000:1.0:1787827151.268291:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddaad expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268297:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddaad expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.268328:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861184:0@lo:256: 00000100:00100000:1.0:1787827151.268350:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.268363:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.268412:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861184 00000100:00100000:0.0:1787827151.268417:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861184 00000100:00100000:0.0:1787827151.268446:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787827151.268451:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580861184:12345-0@lo:256: 20000000:01000000:0.0:1787827151.268461:0:7426:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787827151.268473:0:7426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787827151.268475:0:7426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787827151.268550:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580861184:12345-0@lo:256: Request processed in 97us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.268557:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787827151.268573:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861184:0@lo:256: 10000000:01000000:1.0:1787827151.268618:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787827151.268624:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddaad expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268633:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c600/0xb2e8bd65d71ddaa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddaad expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827151.268640:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787827151.268642:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787827151.268645:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787827151.268659:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268666:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268673:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.268691:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861312:0@lo:101: 00000100:00100000:1.0:1787827151.268725:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.268765:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.268777:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861312 00000100:00100000:0.0:1787827151.268783:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861312 00000100:00100000:0.0:1787827151.268819:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787827151.268826:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580861312:12345-0@lo:101: 00010000:00010000:0.0:1787827151.268833:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827151.268840:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddab4 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.268851:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.268860:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.268867:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c0200, rc 0) 00000100:00100000:0.0:1787827151.268899:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580861312:12345-0@lo:101: Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.268913:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787827151.268916:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861312:0@lo:101: 00010000:00010000:1.0:1787827151.268929:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827151.268938:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827151.268991:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861440:0@lo:501: 00000100:00100000:1.0:1787827151.269015:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.269037:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.269079:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861440 00000100:00100000:2.0:1787827151.269084:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861440 00000100:00100000:2.0:1787827151.269114:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787827151.269121:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580861440:12345-0@lo:501: 00000100:00100000:2.0:1787827151.269219:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580861440:12345-0@lo:501: Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.269227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787827151.269234:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861440:0@lo:501: 00000100:00100000:1.0:1787827151.269264:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861568:0@lo:503: 00000100:00100000:1.0:1787827151.269299:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.269316:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40be40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.269331:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861568 00000100:00100000:2.0:1787827151.269336:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861568 00000100:00100000:2.0:1787827151.269363:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787827151.269370:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580861568:12345-0@lo:503: 00000100:00100000:1.0:1787827151.269495:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580861568:0@lo:503: 00000100:00100000:2.0:1787827151.269500:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580861568:12345-0@lo:503: Request processed in 114us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.269510:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787827151.269796:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10063:1874672580861696:0@lo:502: 00000100:00100000:1.0:1787827151.269829:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.269856:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbd40b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.270079:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861696 00000100:00100000:0.0:1787827151.270085:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861696 00000100:00100000:0.0:1787827151.270125:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787827151.270133:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10063:x1874672580861696:12345-0@lo:502: 00000100:00100000:0.0:1787827151.270229:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10063:x1874672580861696:12345-0@lo:502: Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.270237:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787827151.270244:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10063:1874672580861696:0@lo:502: 00000020:01000000:2.0:1787827151.270271:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787827151.270278:0:10063:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787827151.270286:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827151.270289:0:10063:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787827151.270295:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787827151.270299:0:10063:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787827151.270320:0:10063:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787827151.270328:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787827151.270342:0:10063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f8bbf9a8000) 00000020:00000080:2.0:1787827151.270373:0:10063:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787827151.270407:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787827151.270490:0:10063:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787827151.270495:0:10063:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787827151.270503:0:10063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb2e8bd65d71ddac9 00010000:00080000:2.0:1787827151.270529:0:10063:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f8bbf985000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787827151.270732:0:10063:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787827151.270885:0:10063:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787827151.270895:0:10063:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787827151.271078:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827151.271187:0:10063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787827151.271303:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787827151.271444:0:10063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787827151.272183:0:10064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787827151.272192:0:10064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787827151.272653:0:10063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787827151.272663:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787827151.272696:0:10063:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787827151.272717:0:10063:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71ddad0 00000100:00080000:2.0:1787827151.272725:0:10063:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787827151.272730:0:10063:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f8bbf985000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787827151.272780:0:10063:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f8b9299f840 x1874672580861824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787827151.272796:0:10063:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787827151.272883:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827151.272888:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827151.272890:0:10063:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787827151.272893:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827151.272896:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827151.272898:0:10063:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787827151.272901:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787827151.272907:0:10063:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787827151.272938:0:10063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10063:1874672580861952:0@lo:502: 00000100:00100000:2.0:1787827151.273003:0:10063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.273037:0:10063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98023600 going to sleep for 11 seconds 00000100:00100000:3.0:1787827151.273068:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b9299cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8410:x1874672580860544:12345-0@lo:700: Request processed in 7180us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.273080:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787827151.273110:0:3612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580861824:0@lo:8: 00000100:00100000:3.0:1787827151.273132:0:8410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8410:1874672580860544:0@lo:700: 40000000:02000000:3.0:1787827151.273144:0:8410:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1787827151.273156:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827151.273199:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861952 00000100:00100000:0.0:1787827151.273204:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861952 00000100:00100000:0.0:1787827151.273242:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787827151.273251:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10063:x1874672580861952:12345-0@lo:502: 00000100:00100000:0.0:1787827151.273345:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10063:x1874672580861952:12345-0@lo:502: Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.273352:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787827151.273393:0:10063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10063:1874672580861952:0@lo:502: 00000020:01000000:1.0:1787827151.273425:0:10063:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827151.273431:0:10063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827151.273433:0:10063:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787827151.273437:0:10063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:2.0:1787827151.273466:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580861824 00000100:00100000:2.0:1787827151.273471:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580861824 00000100:00100000:2.0:1787827151.273497:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787827151.273502:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86726580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3612:x1874672580861824:12345-0@lo:8: 00010000:00080000:2.0:1787827151.273525:0:9450:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000020:00000080:2.0:1787827151.273551:0:9450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb2e8bd65d71ddad7 00002000:00100000:2.0:1787827151.273563:0:9450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f8bbfa82800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113941 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787827151.273566:0:9450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787827151.273568:0:9450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787827151.273621:0:9450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787827151.273643:0:9450:0:(import.c:65:import_set_state_nolock()) ffff8f8bbfa83800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787827151.273676:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86726580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3612:x1874672580861824:12345-0@lo:8: Request processed in 173us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827151.273683:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:01000000:2.0:1787827151.273698:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 00010000:00080000:0.0:1787827151.273704:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b9299f840 x1874672580861824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787827161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827151.273713:0:3612:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 10000000:01000000:2.0:1787827151.273716:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00080000:0.0:1787827151.273718:0:3612:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787827151.273723:0:3612:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00010000:2.0:1787827151.273724:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787827151.273733:0:3612:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00010000:00010000:2.0:1787827151.273734:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787827151.273735:0:3612:0:(import.c:65:import_set_state_nolock()) ffff8f8bbf985000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787827151.273742:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787827151.273756:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b988b19b8 from 1 10000000:01000000:2.0:1787827151.273764:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:0.0:1787827151.273765:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787827151.273770:0:3612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1874672580861824:0@lo:8: 00000004:00080000:0.0:1787827151.273787:0:10064:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1787827151.273793:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.273800:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.273808:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827151.273820:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580862080:0@lo:101: 00000004:00080000:0.0:1787827151.273826:0:10064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 103923446945ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787827151.273831:0:10064:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787827151.273846:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.273862:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98023600 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.273871:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862080 00000100:00100000:0.0:1787827151.273874:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862080 00000100:00100000:0.0:1787827151.273896:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787827151.273902:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580862080:12345-0@lo:101: 00010000:00010000:0.0:1787827151.273909:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827151.273921:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddade expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.273947:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 24 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.273957:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 24 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827151.273966:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c1400, rc 0) 00000100:00100000:0.0:1787827151.273992:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580862080:12345-0@lo:101: Request processed in 90us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.273998:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787827151.274128:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580862080:0@lo:101: 00010000:00010000:2.0:1787827151.274137:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.274143:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827151.274172:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580862208:0@lo:501: 00000100:00100000:2.0:1787827151.274187:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.274202:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98023600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.274217:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862208 00000100:00100000:1.0:1787827151.274221:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862208 00000100:00100000:1.0:1787827151.274252:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787827151.274257:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580862208:12345-0@lo:501: 00000100:00100000:1.0:1787827151.274307:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580862208:12345-0@lo:501: Request processed in 50us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827151.274314:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787827151.274330:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580862208:0@lo:501: 10000000:01000000:2.0:1787827151.274348:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787827151.274353:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827151.274360:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787827151.275986:0:6463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787827151.277048:0:10065:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787827151.277075:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862464:0@lo:7: 00000100:00100000:1.0:1787827151.277146:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827151.277188:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862464 00000100:00100000:1.0:1787827151.277194:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862464 00000100:00100000:0.0:1787827151.277233:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580862336:0@lo:13: 00000100:00100000:1.0:1787827151.277251:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787827151.277260:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10065:x1874672580862464:12345-0@lo:7: 00000100:00100000:0.0:1787827151.277317:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827151.277443:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862336 00000100:00100000:0.0:1787827151.277456:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862336 00000100:00100000:0.0:1787827151.277538:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787827151.277550:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a867243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1874672580862336:12345-0@lo:13: 00002000:00000024:0.0:1787827151.277574:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000100:00100000:0.0:1787827151.277653:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a867243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1874672580862336:12345-0@lo:13: Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.277661:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787827151.277724:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92b92d00 x1874672580862336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827151.277759:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580862336:0@lo:13: 00000100:00080000:0.0:1787827151.277817:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827151.277841:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868540 going to sleep for 11 seconds 00000001:00100000:2.0:1787827151.280485:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787827151.280494:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787827151.280502:0:9478:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cef8de3-2326-42de-9d41-f4cb057ed6e8 00000100:00100000:3.0:1787827151.280629:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10061:x1874672580860416:12345-0@lo:700: Request processed in 14931us (15090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.280647:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787827151.280653:0:10061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865af840 x1874672580860416/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827151.280669:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580860416:0@lo:700: 00002000:00080000:1.0:1787827151.281715:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787827151.281721:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787827151.281857:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10065:x1874672580862464:12345-0@lo:7: Request processed in 4597us (4709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.281867:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787827151.281985:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b92b90f00 x1874672580862464/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827151.282004:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b90f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862464:0@lo:7: 00000004:00080000:0.0:1787827151.282015:0:10065:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787827151.282049:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862592:0@lo:5: 00000100:00100000:0.0:1787827151.282083:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827151.282106:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b92a30900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.282198:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862592 00000100:00100000:2.0:1787827151.282205:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862592 00000100:00100000:2.0:1787827151.282244:0:9452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787827151.282253:0:9452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:10065:x1874672580862592:12345-0@lo:5: 00002000:00080000:2.0:1787827151.282274:0:9452:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787827151.282277:0:9452:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787827151.282530:0:9452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:10065:x1874672580862592:12345-0@lo:5: Request processed in 279us (447us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787827151.282537:0:9452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787827151.282564:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a86725680 x1874672580862592/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827151.282586:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862592:0@lo:5: 00000004:00080000:3.0:1787827151.282602:0:10065:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787827151.282627:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862720:0@lo:700: 00000100:00100000:3.0:1787827151.282649:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.282664:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf9139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827151.282676:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862720 00000100:00100000:2.0:1787827151.282680:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862720 00000100:00100000:2.0:1787827151.282700:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787827151.282705:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10065:x1874672580862720:12345-0@lo:700: 00000004:00080000:3.0:1787827151.283928:0:10061:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787827151.283950:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580862848:0@lo:13: 00000100:00100000:3.0:1787827151.283951:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580862976:0@lo:7: 00000100:00100000:2.0:1787827151.284001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.284028:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827151.284041:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862848 00000100:00100000:0.0:1787827151.284047:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862848 00000100:00100000:3.0:1787827151.284064:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.284079:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580862976 00000100:00100000:0.0:1787827151.284085:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787827151.284093:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580862848:12345-0@lo:13: 00000100:00100000:1.0:1787827151.284095:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580862976 00002000:00000024:0.0:1787827151.284111:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923951616 avail 3692429312 00000100:00100000:1.0:1787827151.284140:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787827151.284149:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10061:x1874672580862976:12345-0@lo:7: 00000100:00100000:0.0:1787827151.284161:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1874672580862848:12345-0@lo:13: Request processed in 68us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.284168:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787827151.284204:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865ade00 x1874672580862848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827151.284223:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580862848:0@lo:13: 00002000:00080000:2.0:1787827151.289092:0:9450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787827151.289107:0:9450:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787827151.289197:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10061:x1874672580862976:12345-0@lo:7: Request processed in 5046us (5167us total) trans 0 rc 0/0 00010000:00080000:3.0:1787827151.289224:0:10061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865ae940 x1874672580862976/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827151.289225:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787827151.289242:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580862976:0@lo:7: 00000004:00080000:3.0:1787827151.289258:0:10061:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787827151.289327:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580863104:0@lo:5: 00000100:00100000:3.0:1787827151.289355:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.289506:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.289562:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863104 00000100:00100000:1.0:1787827151.289574:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863104 00000001:00080000:2.0:1787827151.289609:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787827151.289623:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787827151.289634:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10061:x1874672580863104:12345-0@lo:5: 00002000:00080000:1.0:1787827151.289658:0:8402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787827151.289696:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10061:x1874672580863104:12345-0@lo:5: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827151.289702:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787827151.289710:0:10061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1d8b40 x1874672580863104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827151.289722:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10065:x1874672580862720:12345-0@lo:700: Request processed in 7013us (7068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827151.289723:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580863104:0@lo:5: 00000100:00100000:0.0:1787827151.289737:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:3.0:1787827151.289739:0:10061:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1787827151.289755:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865af840 x1874672580862720/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827151.289766:0:10065:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787827151.289779:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580862720:0@lo:700: 00000100:00100000:3.0:1787827151.289788:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580863232:0@lo:5: 00000100:00100000:3.0:1787827151.289815:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.289837:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.289861:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863232 00000100:00100000:0.0:1787827151.289867:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863232 00000100:00100000:0.0:1787827151.289897:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827151.289906:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10061:x1874672580863232:12345-0@lo:5: 00002000:00080000:0.0:1787827151.289929:0:8400:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000004:02000040:2.0:1787827151.291213:0:10065:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1787827151.291777:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:10061:x1874672580863232:12345-0@lo:5: Request processed in 1869us (1958us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787827151.291788:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787827151.291795:0:10061:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1d8b40 x1874672580863232/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827151.291806:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10061:1874672580863232:0@lo:5: 00000004:00080000:3.0:1787827151.291816:0:10061:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787827151.291844:0:10061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10061:1874672580863360:0@lo:900: 00000100:00100000:3.0:1787827151.291872:0:10061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827151.291890:0:10061:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827151.291900:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863360 00000100:00100000:0.0:1787827151.291906:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863360 00000100:00100000:0.0:1787827151.291953:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787827151.291962:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10061:x1874672580863360:12345-0@lo:900: 00000100:00100000:0.0:1787827151.292007:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10061:x1874672580863360:12345-0@lo:900: Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827151.292014:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787827151.292029:0:10061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10061:1874672580863360:0@lo:900: 00000100:00100000:2.0:1787827151.294665:0:10065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf971e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580863488:0@lo:5: 00000100:00100000:2.0:1787827151.294709:0:10065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827151.294739:0:10065:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98023600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827151.294757:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863488 00000100:00100000:1.0:1787827151.294765:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863488 00000100:00100000:1.0:1787827151.294814:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787827151.294823:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:10065:x1874672580863488:12345-0@lo:5: 00002000:00080000:1.0:1787827151.298246:0:9450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787827151.298265:0:9450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787827151.299639:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf970b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:10065:x1874672580863488:12345-0@lo:5: Request processed in 4812us (4923us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787827151.299651:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787827151.299662:0:10065:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf971e00 x1874672580863488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787827167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827151.299684:0:10065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf971e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10065:1874672580863488:0@lo:5: 00000004:00080000:2.0:1787827151.299698:0:10065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1787827151.510577:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827152.404819:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827152.404890:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572435968 00000100:00100000:0.0:1787827152.404898:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572435968 00000100:00080000:2.0:1787827152.404958:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827152.404962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1787827152.404973:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf971680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:6232:x1874672572435968:12345-192.168.203.29@tcp:41: 00000004:00000024:0.0:1787827152.405009:0:6485:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787827152.405073:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf971680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:6232:x1874672572435968:12345-192.168.203.29@tcp:41: Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827152.405081:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1787827152.406824:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827152.406884:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436096 00000100:00100000:2.0:1787827152.406895:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436096 00000100:00100000:2.0:1787827152.406971:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00080000:0.0:1787827152.406979:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827152.406983:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6232:x1874672572436096:12345-192.168.203.29@tcp:13: 00002000:00000024:2.0:1787827152.407009:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827152.407070:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:6232:x1874672572436096:12345-192.168.203.29@tcp:13: Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827152.407078:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787827152.408123:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827152.408169:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436224 00000100:00100000:3.0:1787827152.408175:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436224 00000100:00080000:0.0:1787827152.408227:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827152.408227:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1787827152.408239:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:6232:x1874672572436224:12345-192.168.203.29@tcp:13: 00002000:00000024:3.0:1787827152.408260:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827152.408303:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:6232:x1874672572436224:12345-192.168.203.29@tcp:13: Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827152.408309:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:3.0:1787827152.535788:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827153.405370:0:10150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787827153.558632:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787827154.582689:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787827154.697132:0:10297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed21d4790 20000000:00000080:0.0:1787827154.697146:0:10297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8bbf915c00 uarg=0000000000000000 20000000:01000000:0.0:1787827154.697180:0:10297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787827154.697183:0:10297:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787827154.697185:0:10297:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787827154.697190:0:10297:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787827154.697195:0:10297:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787827154.697245:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787827154.697248:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787827154.697588:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787827154.697735:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787827154.697765:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787827154.697782:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787827154.697792:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787827154.697794:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787827154.698049:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1787827154.698153:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1787827154.698171:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1787827154.698182:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1787827154.698190:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787827154.698196:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787827154.698349:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787827154.698587:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787827154.698613:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787827154.698630:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787827154.698639:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787827154.698641:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787827154.698798:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1787827154.698989:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1787827154.699009:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1787827154.699021:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1787827154.699029:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787827154.699031:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787827154.699188:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787827154.699265:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787827154.699285:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787827154.699297:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1787827154.699306:0:10297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787827154.699320:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699334:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 23 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699342:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699350:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699358:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699375:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699411:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699419:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699426:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 23 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699433:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699439:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699445:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 23 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699453:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699488:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 23 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699502:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 23 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.699527:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf970780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863616:0@lo:104: 00000100:00100000:2.0:1787827154.699587:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827154.699642:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699649:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 23 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.699654:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf970f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863744:0@lo:104: 00000100:00100000:2.0:1787827154.699669:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827154.699698:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699707:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 23 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.699712:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863616 00000100:00100000:2.0:1787827154.699718:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf971a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863872:0@lo:104: 00000100:00100000:3.0:1787827154.699731:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863616 00000100:00100000:2.0:1787827154.699765:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827154.699815:0:6468:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787827154.699817:0:7424:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1787827154.699823:0:9487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863744 00000100:00100000:0.0:1787827154.699824:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580863872 00000100:00100000:1.0:1787827154.699829:0:9487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863744 00000100:00100000:0.0:1787827154.699830:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580863872 00000100:00100000:2.0:1787827154.699831:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787827154.699843:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10297:x1874672580863616:12345-0@lo:104: 00010000:00010000:2.0:1787827154.699855:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.699876:0:9487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787827154.699885:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787827154.699886:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 23 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.699887:0:9487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10297:x1874672580863744:12345-0@lo:104: 00000100:00100000:0.0:1787827154.699898:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10297:x1874672580863872:12345-0@lo:104: 00010000:00010000:1.0:1787827154.699902:0:9487:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.699907:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 23 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.699911:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699912:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787827154.699924:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10297:x1874672580863616:12345-0@lo:104: Request processed in 81us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827154.699933:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864000:0@lo:104: 00000100:00100000:2.0:1787827154.699938:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787827154.699940:0:9487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787827154.699946:0:9487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10297:x1874672580863744:12345-0@lo:104: Request processed in 63us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827154.699952:0:9487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787827154.699967:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1787827154.699973:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.699975:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787827154.699979:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787827154.699980:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.699984:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1c1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10297:x1874672580863872:12345-0@lo:104: Request processed in 89us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1787827154.699986:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.699991:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbd36b800 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827154.699997:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.699999:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5ce00 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:0.0:1787827154.700001:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787827154.700003:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827154.700004:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700013:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700024:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787827154.700027:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700029:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 23 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787827154.700031:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700036:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864000 10000000:01000000:2.0:1787827154.700041:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827154.700042:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864000 10000000:01000000:1.0:1787827154.700051:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787827154.700055:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864128:0@lo:104: 00000100:00100000:0.0:1787827154.700068:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787827154.700075:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700075:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700078:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10297:x1874672580864000:12345-0@lo:104: 00000100:00100000:3.0:1787827154.700085:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827154.700092:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827154.700093:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787827154.700098:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700100:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700109:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700110:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700121:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36b800/0xb2e8bd65d71ddade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddae5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700128:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5ce00/0xb2e8bd65d71ddab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71ddabb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700137:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827154.700137:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827154.700139:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827154.700141:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700142:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787827154.700142:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787827154.700142:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 23 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700149:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700155:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1da580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10297:x1874672580864000:12345-0@lo:104: Request processed in 77us (179us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827154.700155:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa8000 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827154.700160:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700171:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864512:0@lo:104: 00010000:00010000:2.0:1787827154.700175:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700186:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5da00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827154.700187:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700188:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 10000000:00010000:1.0:1787827154.700191:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827154.700197:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787827154.700200:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700205:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864128 10000000:00010000:1.0:1787827154.700208:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700209:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827154.700211:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864128 00010000:00010000:2.0:1787827154.700215:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827154.700218:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787827154.700228:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864512 00000100:00100000:0.0:1787827154.700232:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864512 00010000:00010000:2.0:1787827154.700233:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787827154.700235:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700237:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700241:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700249:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787827154.700255:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827154.700259:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8000/0xb2e8bd65d71dda98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda9f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700259:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 23 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700260:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580864128:12345-0@lo:104: 00010000:00010000:1.0:1787827154.700269:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700274:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700284:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827154.700285:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864768:0@lo:104: 00010000:00010000:2.0:1787827154.700287:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827154.700289:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5da00/0xb2e8bd65d71dda6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda75 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700291:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827154.700303:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827154.700307:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827154.700309:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827154.700312:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787827154.700320:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864256:0@lo:103: 00000100:00100000:2.0:1787827154.700321:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580864512:12345-0@lo:104: 00000100:00100000:3.0:1787827154.700329:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700330:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827154.700339:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580864128:12345-0@lo:104: Request processed in 78us (256us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827154.700339:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.700355:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787827154.700355:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700360:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827154.700372:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864768 00000100:00100000:0.0:1787827154.700393:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864768 00010000:00010000:2.0:1787827154.700405:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1787827154.700407:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 9 pid: 6479 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700414:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580864512:12345-0@lo:104: Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827154.700417:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787827154.700421:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864384:0@lo:103: 00000100:00100000:3.0:1787827154.700427:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1dbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865024:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787827154.700431:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787827154.700432:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580864768:12345-0@lo:104: 00010000:00010000:0.0:1787827154.700441:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700451:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700474:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787827154.700480:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10297:x1874672580864768:12345-0@lo:104: Request processed in 54us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827154.700487:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787827154.700494:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787827154.700502:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864640:0@lo:103: 00010000:00010000:0.0:1787827154.700513:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787827154.700519:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700528:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700538:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5c000 already unused, calling callback (ffffffffc1503c20) 00000100:00100000:2.0:1787827154.700540:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864256 10000000:00010000:0.0:1787827154.700543:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700544:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864256 00010000:00010000:0.0:1787827154.700552:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700561:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580864896:0@lo:103: 10000000:00010000:0.0:1787827154.700563:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827154.700572:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787827154.700588:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 24 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700592:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700596:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700603:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700605:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787827154.700615:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787827154.700616:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700616:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864384 00010000:00010000:3.0:1787827154.700618:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700621:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864384 00000100:00100000:1.0:1787827154.700623:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580865152:0@lo:103: 00010000:00010000:2.0:1787827154.700636:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 25 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700637:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71dda52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda59 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700643:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865280:192.168.203.29@tcp:104: 00000100:00100000:1.0:1787827154.700651:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700659:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787827154.700664:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700664:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864640 00000100:00100000:2.0:1787827154.700669:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864640 00010000:00010000:0.0:1787827154.700675:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5c200 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:0.0:1787827154.700679:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700681:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580864896 00010000:00010000:2.0:1787827154.700684:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 26 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700686:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580864896 00000100:00100000:2.0:1787827154.700698:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865152 00010000:00010000:1.0:1787827154.700699:0:7425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 27 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700701:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700701:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865152 00010000:00010000:2.0:1787827154.700716:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 28 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787827154.700732:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700741:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 10000000:01000000:0.0:1787827154.700747:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827154.700752:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb888f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3613:x1874672580864256:12345-0@lo:103: 00000100:00100000:2.0:1787827154.700752:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787827154.700756:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 28 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700762:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3613:x1874672580864384:12345-0@lo:103: 00010000:00010000:1.0:1787827154.700763:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827154.700765:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700771:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 28 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700773:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 28 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700775:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827154.700782:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 28 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700785:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827154.700799:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 28 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700800:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865408:0@lo:104: 00010000:00010000:0.0:1787827154.700803:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700822:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71dda44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda4b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.700824:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 28 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700830:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700843:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787827154.700848:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.700851:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827154.700852:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827154.700856:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b85e5d400 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:0.0:1787827154.700860:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700863:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 28 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700873:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.700879:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 28 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787827154.700886:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700886:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb888f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+28:3613:x1874672580864256:12345-0@lo:103: Request processed in 134us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827154.700896:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865664:0@lo:104: 10000000:01000000:0.0:1787827154.700904:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787827154.700905:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787827154.700927:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700934:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787827154.700938:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.700944:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.700945:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+27:3613:x1874672580864384:12345-0@lo:103: Request processed in 184us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827154.700952:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787827154.700957:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b98023600 going to sleep for 11 seconds 00010000:00010000:0.0:1787827154.700959:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5d400/0xb2e8bd65d71dda36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dda3d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.700964:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+27:3613:x1874672580864640:12345-0@lo:103: 00000100:00100000:2.0:1787827154.700972:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787827154.700977:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71ddade expref: 27 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.700981:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827154.700983:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827154.700985:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827154.700991:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827154.700991:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787827154.700992:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 25 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.700993:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf970780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863616:0@lo:104: 00000100:00100000:2.0:1787827154.701002:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+25:3615:x1874672580864896:12345-0@lo:103: 00010000:00010000:1.0:1787827154.701009:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 25 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.701010:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787827154.701010:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827154.701014:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddabb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71ddab4 expref: 25 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701018:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 25 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.701025:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+25:3615:x1874672580865152:12345-0@lo:103: 00010000:00010000:1.0:1787827154.701029:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827154.701038:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf970f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863744:0@lo:104: 00010000:00010000:0.0:1787827154.701040:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827154.701048:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 24 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701049:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 24 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827154.701052:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81475c00/0xb2e8bd65d71dda9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dda98 expref: 24 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701063:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3613:x1874672580864640:12345-0@lo:103: Request processed in 100us (532us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827154.701076:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 23 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701079:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787827154.701079:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf971a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580863872:0@lo:104: 00010000:00010000:3.0:1787827154.701099:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8200/0xb2e8bd65d71dda75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dda6e expref: 22 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701100:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827154.701101:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787827154.701112:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864000:0@lo:104: 00010000:00010000:3.0:1787827154.701123:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71dda59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dda52 expref: 21 pid: 6479 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.701134:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864128:0@lo:104: 00000100:00100000:2.0:1787827154.701145:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:3615:x1874672580864896:12345-0@lo:103: Request processed in 144us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827154.701147:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:3615:x1874672580865152:12345-0@lo:103: Request processed in 125us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827154.701149:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864512:0@lo:104: 00000100:00100000:0.0:1787827154.701164:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787827154.701166:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580864768:0@lo:104: 00000100:00100000:1.0:1787827154.701171:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580865792:0@lo:103: 00000100:00100000:2.0:1787827154.701171:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787827154.701187:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827154.701200:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827154.701200:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865408 00000100:00100000:0.0:1787827154.701201:0:7424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865664 00000100:00100000:2.0:1787827154.701204:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865408 00000100:00100000:0.0:1787827154.701210:0:7424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865664 00000100:00100000:1.0:1787827154.701219:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827154.701222:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787827154.701227:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580865536:0@lo:103: 00000100:00100000:2.0:1787827154.701230:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580865408:12345-0@lo:104: 00000100:00100000:0.0:1787827154.701237:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787827154.701238:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.701248:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580865664:12345-0@lo:104: 00000100:00100000:1.0:1787827154.701249:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827154.701259:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701274:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865792 00000100:00100000:1.0:1787827154.701279:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865792 00010000:00010000:1.0:1787827154.701294:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 19 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701309:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865536 00000100:00100000:1.0:1787827154.701312:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865536 00010000:00010000:1.0:1787827154.701322:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 20 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701337:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787827154.701342:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:3614:x1874672580865792:12345-0@lo:103: 00010000:00010000:1.0:1787827154.701350:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827154.701359:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 20 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701368:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787827154.701369:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 20 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.701374:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10297:x1874672580865408:12345-0@lo:104: Request processed in 146us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827154.701401:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1787827154.701409:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81474a00/0xb2e8bd65d71dda3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dda36 expref: 20 pid: 6476 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.701419:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827154.701423:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787827154.701430:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787827154.701431:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10297:x1874672580865664:12345-0@lo:104: Request processed in 186us (494us total) trans 0 rc 0/0 00010000:00010000:2.0:1787827154.701438:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.701442:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787827154.701450:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:3614:x1874672580865792:12345-0@lo:103: Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827154.701457:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787827154.701458:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa8800 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827154.701461:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.701462:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787827154.701470:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701473:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701475:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787827154.701484:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3614:x1874672580865536:12345-0@lo:103: 00010000:00010000:0.0:1787827154.701489:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a865c1600 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827154.701490:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.701493:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1787827154.701494:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827154.701498:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787827154.701499:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.701515:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701518:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.701522:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787827154.701528:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.701530:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1db840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865408:0@lo:104: 00010000:00010000:2.0:1787827154.701531:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827154.701538:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71dda4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dda44 expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701543:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827154.701546:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787827154.701546:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865af840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865664:0@lo:104: 00010000:00010000:1.0:1787827154.701555:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827154.701558:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8800/0xb2e8bd65d71dd9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9b1 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701569:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827154.701571:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827154.701574:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827154.701581:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701582:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:3614:x1874672580865536:12345-0@lo:103: Request processed in 99us (334us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827154.701596:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787827154.701600:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787827154.701606:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.701618:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1600/0xb2e8bd65d71dd980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd987 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.701619:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580865920:0@lo:103: 00000100:00100000:1.0:1787827154.701631:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580866048:0@lo:103: 00010000:00010000:0.0:1787827154.701632:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827154.701636:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827154.701638:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827154.701657:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827154.701671:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827154.701690:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580865920 00000100:00100000:3.0:1787827154.701692:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86726d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580865152:0@lo:103: 00000100:00100000:0.0:1787827154.701695:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580865920 00000100:00100000:2.0:1787827154.701708:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866048 00000100:00100000:3.0:1787827154.701708:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580864896:0@lo:103: 00000100:00100000:2.0:1787827154.701715:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866048 00010000:00010000:0.0:1787827154.701716:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 17 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701736:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580865536:0@lo:103: 00010000:00010000:2.0:1787827154.701743:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 18 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.701751:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580865792:0@lo:103: 00000100:00100000:0.0:1787827154.701759:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787827154.701770:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787827154.701772:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb888c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3615:x1874672580865920:12345-0@lo:103: 00000100:00100000:3.0:1787827154.701780:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864640:0@lo:103: 00010000:00010000:0.0:1787827154.701782:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787827154.701788:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:3616:x1874672580866048:12345-0@lo:103: 00010000:00010000:0.0:1787827154.701793:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.701796:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864256:0@lo:103: 00010000:00010000:1.0:1787827154.701799:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827154.701799:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827154.701807:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 18 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827154.701814:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a7d14451-881f-46a5-81e7-5eca8cfcf000:3613:1874672580864384:0@lo:103: 00010000:00010000:0.0:1787827154.701815:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701832:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 18 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.701847:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81475e00/0xb2e8bd65d71dd9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd9aa expref: 18 pid: 6478 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.701851:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81474200/0xb2e8bd65d71dd987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd980 expref: 18 pid: 7426 timeout: 257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827154.701863:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787827154.701867:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787827154.701891:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb888c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3615:x1874672580865920:12345-0@lo:103: Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827154.701895:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787827154.701917:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580865920:0@lo:103: 00000100:00100000:2.0:1787827154.701968:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580866048:12345-0@lo:103: Request processed in 184us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827154.701975:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787827154.701991:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580866048:0@lo:103: 00000100:00100000:3.0:1787827154.702419:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1dbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865024:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787827154.702428:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1da940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1874672580865280:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787827154.702600:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827154.702653:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827154.702688:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436352 00000100:00100000:1.0:1787827154.702693:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436352 00010000:00010000:1.0:1787827154.702710:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 10 pid: 6479 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827154.702750:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1787827154.702759:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86727840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2396:x1874672572436352:12345-192.168.203.29@tcp:103: 00010000:00010000:1.0:1787827154.702767:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827154.702771:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 10 pid: 6479 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.702782:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 10 pid: 6479 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.702792:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa9600/0xb2e8bd65d71dd9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba1346961b expref: 10 pid: 6479 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827154.702801:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787827154.702832:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86727840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:2396:x1874672572436352:12345-192.168.203.29@tcp:103: Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827154.702838:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1787827154.703230:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827154.703271:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436480 00000100:00100000:2.0:1787827154.703276:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436480 00010000:00010000:2.0:1787827154.703292:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.703315:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1787827154.703320:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:2397:x1874672572436480:12345-192.168.203.29@tcp:103: 00010000:00010000:2.0:1787827154.703326:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827154.703330:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703340:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703350:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81474800/0xb2e8bd65d71dd9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469614 expref: 9 pid: 6476 timeout: 207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703367:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703375:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703419:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703426:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703433:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703440:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703446:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbd36a800 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:2.0:1787827154.703449:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703454:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703465:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827154.703472:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787827154.703488:0:10297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.703496:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:2397:x1874672572436480:12345-192.168.203.29@tcp:103: Request processed in 174us (267us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827154.703502:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827154.703509:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00010000:00010000:3.0:1787827154.703516:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbd36a800/0xb2e8bd65d71ddaec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827155.350638:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787827155.350664:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580866176:0@lo:13: 00000100:00100000:1.0:1787827155.350741:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827155.350778:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787827155.350792:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580866304:0@lo:13: 00000100:00100000:2.0:1787827155.350808:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866176 00000100:00100000:2.0:1787827155.350815:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866176 00000100:00100000:3.0:1787827155.350831:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827155.350867:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866304 00000100:00100000:2.0:1787827155.350872:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866304 00000100:00100000:2.0:1787827155.350897:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787827155.350902:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787827155.350905:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580866176:12345-0@lo:13: 00000100:00100000:1.0:1787827155.350913:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:0.0:1787827155.350919:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787827155.350933:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827155.350983:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580866176:12345-0@lo:13: Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827155.350990:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827155.351010:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787827155.351020:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a867261c0 x1874672580866176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827155.351020:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580866304:12345-0@lo:13: 00000100:00100000:1.0:1787827155.351043:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580866176:0@lo:13: 00002000:00000024:2.0:1787827155.351045:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827155.351082:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865af840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580866304:12345-0@lo:13: Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827155.351089:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787827155.351103:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf973480 x1874672580866304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827155.351127:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580866304:0@lo:13: 00010000:00010000:2.0:1787827155.606535:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827155.862584:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580866560:0@lo:41: 00000100:00100000:1.0:1787827155.862585:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580866432:0@lo:41: 00000100:00100000:2.0:1787827155.862669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827155.862711:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827155.862741:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866560 00000100:00100000:0.0:1787827155.862748:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866560 00000100:00100000:3.0:1787827155.862773:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866432 00000100:00100000:3.0:1787827155.862780:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866432 00000100:00100000:0.0:1787827155.862791:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787827155.862806:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787827155.862807:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580866560:12345-0@lo:41: 00000100:00100000:1.0:1787827155.862821:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580866432:12345-0@lo:41: 00000004:00000024:0.0:1787827155.862846:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:1.0:1787827155.862846:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787827155.862907:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580866432:12345-0@lo:41: Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827155.862915:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787827155.862920:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580866560:12345-0@lo:41: Request processed in 118us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827155.862931:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787827155.862958:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580866432:0@lo:41: 00000100:00100000:2.0:1787827155.863000:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580866560:0@lo:41: 00000100:00100000:0.0:1787827156.048426:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827156.048489:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436608 00000100:00100000:3.0:1787827156.048499:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436608 00000100:00100000:3.0:1787827156.048563:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:3.0:1787827156.048574:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+8:6155:x1874672572436608:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1787827156.048589:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827156.048608:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71ddaf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba1346968b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827156.048635:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71ddaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346968b expref: 9 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827156.048646:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9800/0xb2e8bd65d71ddaf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba1346968b expref: 9 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827156.048655:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9800, rc 0) 00000100:00100000:3.0:1787827156.048725:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572436608:12345-192.168.203.29@tcp:101: Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.048736:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:0.0:1787827156.050158:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827156.050220:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436736 00000100:00100000:2.0:1787827156.050226:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436736 00000100:00100000:2.0:1787827156.050268:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:2.0:1787827156.050277:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572436736:12345-192.168.203.29@tcp:501: 00000100:00100000:2.0:1787827156.050441:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572436736:12345-192.168.203.29@tcp:501: Request processed in 166us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.050458:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:1.0:1787827156.051426:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827156.051480:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436864 00000100:00100000:3.0:1787827156.051486:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436864 00000100:00100000:3.0:1787827156.051520:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:3.0:1787827156.051527:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572436864:12345-192.168.203.29@tcp:503: 00000100:00100000:3.0:1787827156.051613:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572436864:12345-192.168.203.29@tcp:503: Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.051618:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:0.0:1787827156.053080:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827156.053149:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572436992 00000100:00100000:1.0:1787827156.053157:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572436992 00000100:00100000:1.0:1787827156.053205:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1787827156.053214:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6633:x1874672572436992:12345-192.168.203.29@tcp:502: 00000100:00100000:1.0:1787827156.053343:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6633:x1874672572436992:12345-192.168.203.29@tcp:502: Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.053351:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:0.0:1787827156.054303:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827156.054350:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437120 00000100:00100000:1.0:1787827156.054355:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437120 00000100:00100000:1.0:1787827156.054417:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:1.0:1787827156.054436:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6633:x1874672572437120:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787827156.054582:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6633:x1874672572437120:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 156us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.054590:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:2.0:1787827156.056166:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827156.056216:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437248 00000100:00100000:0.0:1787827156.056224:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437248 00000100:00100000:0.0:1787827156.056266:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:0.0:1787827156.056275:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572437248:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827156.056288:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827156.056306:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba13469692 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827156.056333:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469692 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827156.056353:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c0200/0xb2e8bd65d71ddafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469692 expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827156.056360:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c0200, rc 0) 00000100:00100000:0.0:1787827156.056423:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572437248:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 150us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.056441:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:0.0:1787827156.057322:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827156.057365:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437376 00000100:00100000:3.0:1787827156.057370:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437376 00000100:00100000:3.0:1787827156.057424:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:3.0:1787827156.057431:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572437376:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827156.057523:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572437376:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 92us (207us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787827156.057533:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:2.0:1787827156.176519:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827156.176571:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827156.176612:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827156.176625:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437504 00000100:00100000:1.0:1787827156.176639:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437504 00000100:00100000:0.0:1787827156.176657:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437632 00000100:00100000:2.0:1787827156.176664:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827156.176667:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437632 00000100:00100000:3.0:1787827156.176684:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437760 00000100:00100000:3.0:1787827156.176694:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437760 00000100:00100000:2.0:1787827156.176700:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572437888 00000100:00100000:2.0:1787827156.176705:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572437888 00000100:00100000:1.0:1787827156.176770:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787827156.176783:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1787827156.176793:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1787827156.176801:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572437760:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827156.176805:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787827156.176807:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572437504:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827156.176816:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572437632:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827156.176827:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf973840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572437888:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787827156.176890:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf972d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572437760:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.176893:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf973840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572437888:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.176899:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1787827156.176915:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572437632:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.176920:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787827156.176921:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572437504:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 119us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.176942:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1787827156.176952:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00080000:1.0:1787827156.176995:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827156.177000:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787827156.177004:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827156.177006:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827156.374568:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580866688:0@lo:13: 00000100:00100000:3.0:1787827156.374647:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.374707:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf970f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580867200:0@lo:400: 00000100:00100000:0.0:1787827156.374730:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580866816:0@lo:13: 00000100:00100000:3.0:1787827156.374765:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827156.374785:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827156.374840:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580867328:0@lo:400: 00000100:00100000:3.0:1787827156.374842:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580867712:0@lo:400: 00000100:00100000:0.0:1787827156.374880:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.374898:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827156.374915:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580867840:0@lo:400: 00000100:00100000:3.0:1787827156.374931:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580868224:0@lo:400: 00000100:00100000:0.0:1787827156.374955:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827156.374982:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580868352:0@lo:400: 00000100:00100000:3.0:1787827156.374994:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.375055:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867712 00000100:00100000:3.0:1787827156.375060:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867712 00000100:00100000:0.0:1787827156.375071:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.375115:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868224 00000100:00100000:0.0:1787827156.375120:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867840 00000100:00100000:0.0:1787827156.375125:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867840 00000100:00100000:3.0:1787827156.375133:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868224 00000100:00100000:3.0:1787827156.375180:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787827156.375181:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868352 00000100:00100000:1.0:1787827156.375182:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866688 00000100:00100000:0.0:1787827156.375187:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868352 00000100:00100000:1.0:1787827156.375189:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866688 00000100:00100000:3.0:1787827156.375206:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580867712:12345-0@lo:400: 00000100:00100000:0.0:1787827156.375227:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787827156.375242:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86724b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580867840:12345-0@lo:400: 00000100:00100000:3.0:1787827156.375263:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580867712:12345-0@lo:400: Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.375270:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787827156.375315:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86724b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580867840:12345-0@lo:400: Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827156.375315:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787827156.375348:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827156.375350:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580868224:12345-0@lo:400: 00000100:00080000:3.0:1787827156.375355:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787827156.375359:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787827156.375409:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867200 00000100:00100000:0.0:1787827156.375414:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787827156.375417:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867200 00000100:00100000:1.0:1787827156.375427:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866816 00000100:00100000:0.0:1787827156.375428:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86725e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1874672580868352:12345-0@lo:400: 00000100:00100000:1.0:1787827156.375434:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866816 00000100:00100000:3.0:1787827156.375451:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867328 00000100:00100000:3.0:1787827156.375455:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867328 00000100:00100000:1.0:1787827156.375468:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787827156.375480:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3613:x1874672580866688:12345-0@lo:13: 00002000:00000024:1.0:1787827156.375505:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827156.375605:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580868224:12345-0@lo:400: Request processed in 260us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.375606:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86725e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3614:x1874672580868352:12345-0@lo:400: Request processed in 179us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.375616:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787827156.375629:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3613:x1874672580866688:12345-0@lo:13: Request processed in 144us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.375634:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580867200:12345-0@lo:400: 00000100:00100000:2.0:1787827156.375648:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787827156.375649:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787827156.375658:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787827156.375694:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787827156.375725:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf971a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580867072:0@lo:400: 00000100:00100000:1.0:1787827156.375726:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a867270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1874672580866816:12345-0@lo:13: 00000100:00100000:0.0:1787827156.375746:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00002000:00000024:1.0:1787827156.375755:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827156.375757:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86726d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580867328:12345-0@lo:400: 00000100:00100000:2.0:1787827156.375826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.375841:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580867200:12345-0@lo:400: Request processed in 208us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.375847:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a867270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1874672580866816:12345-0@lo:13: Request processed in 133us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.375850:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86726d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580867328:12345-0@lo:400: Request processed in 93us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827156.375866:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787827156.375866:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580867584:0@lo:400: 00000100:00100000:0.0:1787827156.375867:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787827156.375907:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867072 00000100:00100000:3.0:1787827156.375908:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787827156.375914:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867072 00000100:00100000:2.0:1787827156.375922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.375953:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867584 00000100:00100000:2.0:1787827156.375954:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672580868096:0@lo:400: 00000100:00100000:3.0:1787827156.375960:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867584 00000100:00100000:0.0:1787827156.375964:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787827156.375981:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580867072:12345-0@lo:400: 00000100:00100000:2.0:1787827156.376002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.376017:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868096 00000100:00100000:3.0:1787827156.376024:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868096 00000100:00100000:0.0:1787827156.376045:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874672580867072:12345-0@lo:400: Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.376061:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787827156.376073:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787827156.376080:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf971a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874672580867072:0@lo:400: 00010000:00080000:1.0:1787827156.376088:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40c000 x1874672580867840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827156.376091:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580867584:12345-0@lo:400: 00000100:00100000:0.0:1787827156.376092:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787827156.376109:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672580868096:12345-0@lo:400: 00000100:00100000:2.0:1787827156.376111:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787827156.376112:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580867840:0@lo:400: 00000100:00100000:2.0:1787827156.376134:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580866944:0@lo:400: 00000100:00100000:3.0:1787827156.376147:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874672580867584:12345-0@lo:400: Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.376168:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787827156.376182:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40c780 x1874672580868352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827156.376183:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874672580868096:12345-0@lo:400: Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00080000:3.0:1787827156.376198:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827156.376204:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787827156.376206:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580868352:0@lo:400: 00000100:00100000:2.0:1787827156.376211:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787827156.376243:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf972940 x1874672580867712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787827156.376244:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf973480 x1874672580866816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827156.376274:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf972940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580867712:0@lo:400: 00000100:00100000:1.0:1787827156.376276:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580866816:0@lo:13: 00000100:00100000:2.0:1787827156.376285:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580867456:0@lo:400: 00010000:00080000:3.0:1787827156.376302:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40f480 x1874672580868224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827156.376304:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf970780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580867328:0@lo:400: 00000100:00100000:2.0:1787827156.376321:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.376323:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580868224:0@lo:400: 00000100:00100000:2.0:1787827156.376367:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580867968:0@lo:400: 00000100:00100000:3.0:1787827156.376374:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf970f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580867200:0@lo:400: 00000100:00100000:1.0:1787827156.376428:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580866944 00000100:00100000:1.0:1787827156.376434:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580866944 00000100:00100000:0.0:1787827156.376435:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867456 00010000:00080000:3.0:1787827156.376440:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865ade00 x1874672580866688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827156.376442:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867456 00000100:00100000:2.0:1787827156.376456:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827156.376471:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580866688:0@lo:13: 00000100:00100000:0.0:1787827156.376501:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787827156.376502:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787827156.376517:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580866944:12345-0@lo:400: 00000100:00100000:0.0:1787827156.376520:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580867456:12345-0@lo:400: 00000100:00100000:2.0:1787827156.376529:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1874672580867584:0@lo:400: 00000100:00100000:3.0:1787827156.376554:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580867968 00000100:00100000:2.0:1787827156.376561:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1874672580868096:0@lo:400: 00000100:00100000:3.0:1787827156.376562:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580867968 00000100:00100000:1.0:1787827156.376598:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580866944:12345-0@lo:400: Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827156.376604:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580867456:12345-0@lo:400: Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827156.376605:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827156.376613:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf972580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580866944:0@lo:400: 00000100:00100000:1.0:1787827156.376619:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787827156.376624:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787827156.376626:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580867968:12345-0@lo:400: 00000100:00100000:2.0:1787827156.376662:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580867456:0@lo:400: 00000100:00100000:3.0:1787827156.376699:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580867968:12345-0@lo:400: Request processed in 79us (243us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827156.376707:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40f0c0 x1874672580867968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827156.376724:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787827156.376740:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580867968:0@lo:400: 00000001:00100000:1.0:1787827156.377112:0:8396:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cef8de3-2326-42de-9d41-f4cb057ed6e8 00010000:00010000:0.0:1787827156.630600:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787827157.122913:0:10352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca621ebb0 20000000:00000080:3.0:1787827157.122928:0:10352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f8bbd297000 uarg=0000000000000000 20000000:01000000:3.0:1787827157.122967:0:10352:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787827157.122973:0:10352:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787827157.122977:0:10352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787827157.123308:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787827157.123402:0:10352:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787827157.126290:0:10352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787827157.126313:0:10352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787827157.126327:0:10352:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787827157.126341:0:10352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787827157.126358:0:10352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126397:0:10352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126407:0:10352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126415:0:10352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126422:0:10352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126432:0:10352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 9 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126440:0:10352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126494:0:10352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 9 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126509:0:10352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 9 pid: 7426 timeout: 209 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.126523:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868480:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787827157.126607:0:10352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126614:0:10352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 14 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.126621:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868608:0@lo:104: 00000100:00100000:0.0:1787827157.126664:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827157.126697:0:10352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126724:0:10352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 14 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.126726:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787827157.126739:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868736:0@lo:104: 00000100:00100000:2.0:1787827157.126751:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868608 00000100:00100000:2.0:1787827157.126762:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868608 00000100:00100000:0.0:1787827157.126767:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827157.126803:0:10352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.126805:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868736 00000100:00100000:2.0:1787827157.126809:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868736 00010000:00010000:0.0:1787827157.126817:0:10352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 14 pid: 6479 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.126838:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868864:0@lo:104: 00000100:00100000:2.0:1787827157.126838:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787827157.126852:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd294450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10352:x1874672580868608:12345-0@lo:104: 00000100:00100000:0.0:1787827157.126863:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787827157.126865:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827157.126870:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868864 00000100:00100000:3.0:1787827157.126876:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868864 00010000:00010000:0.0:1787827157.126879:0:10352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.126896:0:10352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 14 pid: 6478 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.126906:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868992:0@lo:104: 00000100:00100000:0.0:1787827157.126951:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827157.126957:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580868992 00000100:00100000:3.0:1787827157.126960:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580868992 00010000:00010000:2.0:1787827157.126967:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787827157.126968:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a865a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787827157.126977:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787827157.126987:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787827157.126988:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:10352:x1874672580868736:12345-0@lo:104: 00000100:00100000:2.0:1787827157.126989:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd294450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:10352:x1874672580868608:12345-0@lo:104: Request processed in 138us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827157.126991:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86727c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868608:0@lo:104: 00010000:00010000:3.0:1787827157.127001:0:6468:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127012:0:7424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+6:10352:x1874672580868864:12345-0@lo:104: 00000100:00100000:2.0:1787827157.127019:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787827157.127023:0:7424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127031:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787827157.127036:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127042:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a865c0e00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:0.0:1787827157.127046:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827157.127048:0:6468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787827157.127056:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a7d14451-881f-46a5-81e7-5eca8cfcf000+5:10352:x1874672580868736:12345-0@lo:104: Request processed in 71us (290us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827157.127062:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827157.127063:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 10000000:00010000:0.0:1787827157.127074:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127077:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:0.0:1787827157.127084:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787827157.127088:0:7424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10352:x1874672580868864:12345-0@lo:104: Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827157.127088:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787827157.127103:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+4:10352:x1874672580868992:12345-0@lo:104: 00000100:00100000:1.0:1787827157.127109:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787827157.127116:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127118:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127130:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787827157.127132:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827157.127137:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827157.127137:0:7441:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787827157.127149:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bbcfa9a00 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:1.0:1787827157.127152:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127157:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127158:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787827157.127161:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.127170:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a7d14451-881f-46a5-81e7-5eca8cfcf000+3:10352:x1874672580868992:12345-0@lo:104: Request processed in 69us (218us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827157.127171:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71dd99c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd9a3 expref: -99 pid: 9476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827157.127179:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787827157.127186:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787827157.127194:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580869120:0@lo:103: 10000000:00010000:1.0:1787827157.127196:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127201:0:6473:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787827157.127205:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787827157.127208:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127220:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8b80031800 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:0.0:1787827157.127226:0:6473:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127229:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127234:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827157.127236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787827157.127250:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787827157.127252:0:6473:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827157.127260:0:6473:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787827157.127264:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580869248:0@lo:103: 00000100:00100000:2.0:1787827157.127265:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869120 00010000:00010000:1.0:1787827157.127267:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.127271:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869120 00010000:00010000:0.0:1787827157.127288:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127289:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9a00/0xb2e8bd65d71dd876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd87d expref: -99 pid: 8394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127296:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 15 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.127305:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787827157.127317:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827157.127321:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827157.127324:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827157.127326:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127334:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787827157.127335:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8b80031800/0xb2e8bd65d71dd806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd80d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.127335:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787827157.127349:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3616:x1874672580869120:12345-0@lo:103: 00000100:00100000:3.0:1787827157.127354:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787827157.127359:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827157.127361:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580869376:0@lo:103: 00010000:00010000:2.0:1787827157.127362:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787827157.127363:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827157.127368:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827157.127373:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 15 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827157.127422:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a867261c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868736:0@lo:104: 00010000:00010000:2.0:1787827157.127431:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 15 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127436:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827157.127438:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868864:0@lo:104: 00000100:00100000:3.0:1787827157.127438:0:9488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869248 00000100:00100000:3.0:1787827157.127444:0:9488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869248 00000100:00100000:0.0:1787827157.127455:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b867f1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868992:0@lo:104: 00010000:00010000:3.0:1787827157.127464:0:9488:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 16 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127471:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b81474600/0xb2e8bd65d71dd9a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd99c expref: 16 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127488:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869376 00000100:00100000:1.0:1787827157.127492:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869376 00010000:00010000:2.0:1787827157.127495:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827157.127514:0:8417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 16 pid: 6478 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827157.127514:0:9488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787827157.127528:0:9488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3616:x1874672580869248:12345-0@lo:103: 00000100:00100000:2.0:1787827157.127536:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:3616:x1874672580869120:12345-0@lo:103: Request processed in 191us (308us total) trans 0 rc 0/0 00010000:00010000:3.0:1787827157.127540:0:9488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787827157.127546:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1787827157.127548:0:9488:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 16 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127556:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787827157.127565:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:3614:x1874672580869376:12345-0@lo:103: 00010000:00010000:1.0:1787827157.127577:0:8417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787827157.127578:0:9488:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 15 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127583:0:8417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 15 pid: 6478 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.127587:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580869120:0@lo:103: 00010000:00010000:3.0:1787827157.127594:0:9488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8b85e5c800/0xb2e8bd65d71dd87d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd876 expref: 15 pid: 6476 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127598:0:8417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 15 pid: 6478 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827157.127613:0:9488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787827157.127614:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8a00/0xb2e8bd65d71dd80d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd806 expref: 14 pid: 6478 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.127623:0:8417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787827157.127666:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:3614:x1874672580869376:12345-0@lo:103: Request processed in 104us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827157.127673:0:9488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:3616:x1874672580869248:12345-0@lo:103: Request processed in 140us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827157.127678:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580869248:0@lo:103: 00000100:00100000:1.0:1787827157.127682:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787827157.127691:0:9488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787827157.127693:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827157.127702:0:7441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127723:0:7441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8bb5f0a600 already unused, calling callback (ffffffffc1503c20) 10000000:00010000:2.0:1787827157.127727:0:7441:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827157.127733:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827157.127736:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580869376:0@lo:103: 00010000:00010000:2.0:1787827157.127736:0:7441:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827157.127737:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1787827157.127750:0:7441:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827157.127756:0:7441:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787827157.127783:0:7441:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127789:0:7441:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787827157.127807:0:7441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127823:0:7441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8f8bb5f0a600/0xb2e8bd65d71dd822 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb2e8bd65d71dd829 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.127832:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580869504:0@lo:103: 00010000:00010000:2.0:1787827157.127837:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827157.127840:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827157.127842:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827157.127863:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827157.127901:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869504 00000100:00100000:2.0:1787827157.127905:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869504 00010000:00010000:2.0:1787827157.127919:0:6471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 12 pid: 6479 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827157.127942:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787827157.127947:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb888e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:3614:x1874672580869504:12345-0@lo:103: 00010000:00010000:2.0:1787827157.127953:0:6471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787827157.127958:0:6471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 12 pid: 6479 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127965:0:6471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 12 pid: 6479 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127976:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa9c00/0xb2e8bd65d71dd829 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb2e8bd65d71dd822 expref: 12 pid: 6479 timeout: 259 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827157.127984:0:6471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787827157.128015:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb888e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:3614:x1874672580869504:12345-0@lo:103: Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827157.128021:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787827157.128048:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a7d14451-881f-46a5-81e7-5eca8cfcf000:3614:1874672580869504:0@lo:103: 00000100:00100000:0.0:1787827157.129605:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10352:1874672580868480:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787827157.129606:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1787827157.129650:0:10352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.129674:0:7425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438016 00000100:00100000:1.0:1787827157.129683:0:7425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438016 00010000:00010000:1.0:1787827157.129734:0:7425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 209 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.129765:0:7425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1787827157.129776:0:7425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2397:x1874672572438016:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787827157.129787:0:7425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787827157.129792:0:7425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 209 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129803:0:7425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 209 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129817:0:7425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71dda05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x218c3ba13469653 expref: 10 pid: 7426 timeout: 209 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129829:0:7425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129838:0:7425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129865:0:7425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129872:0:7425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129879:0:7425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129887:0:7425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129903:0:7425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f8a865c1200 already unused, calling callback (ffffffffc0f14420) 00010000:00010000:1.0:1787827157.129911:0:7425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129919:0:7425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129938:0:7425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827157.129948:0:7425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787827157.129973:0:10352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.129986:0:10352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.129997:0:7425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:2397:x1874672572438016:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 219us (392us total) trans 0 rc 0/0 00010000:00010000:0.0:1787827157.130001:0:10352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f8a865c1200/0xb2e8bd65d71ddb01 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827157.130016:0:7425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000001:00080000:2.0:1787827157.401351:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787827157.401363:0:9478:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787827157.654822:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827157.776374:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827157.776558:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438144 00000100:00100000:0.0:1787827157.776572:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438144 00000100:00100000:0.0:1787827157.776639:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:0.0:1787827157.776651:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+9:6155:x1874672572438144:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827157.776674:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827157.776698:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c0600/0xb2e8bd65d71ddb08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x218c3ba13469699 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.776758:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c0600/0xb2e8bd65d71ddb08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469699 expref: 10 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.776771:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c0600/0xb2e8bd65d71ddb08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x218c3ba13469699 expref: 10 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827157.776783:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c0600, rc 0) 00000100:00100000:0.0:1787827157.776865:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572438144:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 216us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827157.776873:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:1.0:1787827157.778014:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827157.778063:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438272 00000100:00100000:1.0:1787827157.778081:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438272 00000100:00100000:1.0:1787827157.778143:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:1.0:1787827157.778151:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572438272:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827157.778284:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572438272:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827157.778294:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:1.0:1787827157.779081:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827157.779129:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438400 00000100:00100000:0.0:1787827157.779139:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438400 00000100:00100000:0.0:1787827157.779199:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:0.0:1787827157.779211:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572438400:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827157.779363:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6155:x1874672572438400:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 154us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827157.779373:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:2.0:1787827157.780942:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827157.781050:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438528 00000100:00100000:1.0:1787827157.781058:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438528 00000100:00100000:1.0:1787827157.781109:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:1.0:1787827157.781120:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6696:x1874672572438528:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787827157.781244:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6696:x1874672572438528:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827157.781253:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:3.0:1787827157.782183:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827157.782225:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438656 00000100:00100000:0.0:1787827157.782231:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438656 00000100:00100000:0.0:1787827157.782272:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:0.0:1787827157.782288:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6696:x1874672572438656:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787827157.782409:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:6696:x1874672572438656:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 98us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827157.782418:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00010000:00010000:0.0:1787827158.678525:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787827159.373328:0:10643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing check_logdir /tmp/testlogs/ 10000000:01000000:0.0:1787827159.574512:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787827159.574524:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8a8571b000 from 48 10000000:01000000:0.0:1787827159.574531:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787827159.574601:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.574616:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.574629:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.574657:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869632:0@lo:101: 00000100:00100000:0.0:1787827159.574762:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.574836:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.574953:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869632 00000100:00100000:1.0:1787827159.574967:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869632 00000100:00100000:1.0:1787827159.575067:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787827159.575078:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+11:6481:x1874672580869632:12345-0@lo:101: 00010000:00010000:1.0:1787827159.575094:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827159.575109:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71ddb16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb0f expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.575133:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71ddb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb0f expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.575144:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5c400/0xb2e8bd65d71ddb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb0f expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.575165:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5c400, rc 0) 00000100:00100000:1.0:1787827159.575237:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580869632:12345-0@lo:101: Request processed in 161us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.575247:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787827159.575286:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869632:0@lo:101: 00010000:00010000:0.0:1787827159.575303:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb16 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.575312:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb16 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.575401:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869760:0@lo:501: 00000100:00100000:0.0:1787827159.575425:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.575447:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.575499:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869760 00000100:00100000:2.0:1787827159.575506:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869760 00000100:00100000:2.0:1787827159.575546:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787827159.575570:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580869760:12345-0@lo:501: 00000100:00100000:2.0:1787827159.575709:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580869760:12345-0@lo:501: Request processed in 146us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.575717:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787827159.575730:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869760:0@lo:501: 00000100:00100000:0.0:1787827159.575767:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869888:0@lo:503: 00000100:00100000:0.0:1787827159.575823:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.575855:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.575880:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580869888 00000100:00100000:2.0:1787827159.575886:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580869888 00000100:00100000:2.0:1787827159.575919:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787827159.575925:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580869888:12345-0@lo:503: 00000100:00100000:2.0:1787827159.576033:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580869888:12345-0@lo:503: Request processed in 108us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.576046:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787827159.576059:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580869888:0@lo:503: 00000100:00100000:2.0:1787827159.576368:0:10664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10664:1874672580870016:0@lo:502: 00000100:00100000:2.0:1787827159.576436:0:10664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.576466:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870016 00000100:00100000:2.0:1787827159.576469:0:10664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda780 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.576474:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870016 00000100:00100000:0.0:1787827159.576517:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787827159.576525:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:10664:x1874672580870016:12345-0@lo:502: 00000100:00100000:0.0:1787827159.576623:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:10664:x1874672580870016:12345-0@lo:502: Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.576629:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787827159.576655:0:10664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10664:1874672580870016:0@lo:502: 00000100:00100000:2.0:1787827159.576707:0:10664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10664:1874672580870144:0@lo:502: 00000100:00100000:2.0:1787827159.576750:0:10664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.576773:0:10664:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda780 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.576804:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870144 00000100:00100000:1.0:1787827159.576809:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870144 00000100:00100000:1.0:1787827159.576844:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787827159.576851:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:10664:x1874672580870144:12345-0@lo:502: 00000100:00100000:1.0:1787827159.576918:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:10664:x1874672580870144:12345-0@lo:502: Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.576923:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787827159.576940:0:10664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10664:1874672580870144:0@lo:502: 00000040:00080000:2.0:1787827159.576964:0:10664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787827159.577073:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787827159.577090:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787827159.577097:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb16 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.577105:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0e00/0xb2e8bd65d71ddb0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb16 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827159.577112:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787827159.577114:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787827159.577116:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787827159.577135:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.577140:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.577150:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.577173:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870272:0@lo:101: 00000100:00100000:0.0:1787827159.577206:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.577219:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868480 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.577289:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870272 00000100:00100000:2.0:1787827159.577294:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870272 00000100:00100000:2.0:1787827159.577319:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787827159.577326:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+12:6481:x1874672580870272:12345-0@lo:101: 00010000:00010000:2.0:1787827159.577335:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827159.577350:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbd36a400/0xb2e8bd65d71ddb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb1d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.577372:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbd36a400/0xb2e8bd65d71ddb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb1d expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.577415:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbd36a400/0xb2e8bd65d71ddb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb1d expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.577424:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbd36a400, rc 0) 00000100:00100000:2.0:1787827159.577458:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870272:12345-0@lo:101: Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.577465:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787827159.577491:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870272:0@lo:101: 00010000:00010000:0.0:1787827159.577504:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.577513:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.577552:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870400:0@lo:501: 00000100:00100000:0.0:1787827159.577576:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.577608:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868480 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.577618:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870400 00000100:00100000:2.0:1787827159.577622:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870400 00000100:00100000:2.0:1787827159.577656:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787827159.577668:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870400:12345-0@lo:501: 00000100:00100000:2.0:1787827159.577789:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870400:12345-0@lo:501: Request processed in 125us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.577796:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787827159.577815:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870400:0@lo:501: 00000100:00100000:0.0:1787827159.577840:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870528:0@lo:503: 00000100:00100000:0.0:1787827159.577867:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.577881:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb8868480 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.577910:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870528 00000100:00100000:1.0:1787827159.577915:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870528 00000100:00100000:1.0:1787827159.577941:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787827159.577948:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870528:12345-0@lo:503: 00000100:00100000:1.0:1787827159.578025:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870528:12345-0@lo:503: Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.578034:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787827159.578050:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870528:0@lo:503: 00000100:00100000:2.0:1787827159.578478:0:10665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10665:1874672580870656:0@lo:502: 00000100:00100000:2.0:1787827159.578514:0:10665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.578539:0:10665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.578567:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870656 00000100:00100000:1.0:1787827159.578580:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870656 00000100:00100000:1.0:1787827159.578640:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787827159.578649:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:10665:x1874672580870656:12345-0@lo:502: 00000100:00100000:1.0:1787827159.578826:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:10665:x1874672580870656:12345-0@lo:502: Request processed in 177us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.578834:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787827159.578865:0:10665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10665:1874672580870656:0@lo:502: 00000020:01000000:2.0:1787827159.578892:0:10665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827159.578902:0:10665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827159.578905:0:10665:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787827159.578911:0:10665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787827159.578933:0:10665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10665:1874672580870784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.578970:0:10665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.578989:0:10665:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.579021:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870784 00000100:00100000:0.0:1787827159.579027:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870784 00000100:00100000:0.0:1787827159.579060:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787827159.579070:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:10665:x1874672580870784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.579167:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:10665:x1874672580870784:12345-0@lo:502:llog_process_th.0 Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.579176:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787827159.579193:0:10665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10665:1874672580870784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787827159.579226:0:10665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787827159.579230:0:10665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827159.579232:0:10665:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787827159.579236:0:10665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787827159.579397:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787827159.579416:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787827159.579428:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.579439:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1200/0xb2e8bd65d71ddb1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb24 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827159.579448:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787827159.579449:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8a8571b000 from 4 10000000:01000000:0.0:1787827159.579452:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787827159.579478:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.579486:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.579495:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.579509:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.579539:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.579562:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.579603:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580870912 00000100:00100000:2.0:1787827159.579608:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580870912 00000100:00100000:2.0:1787827159.579639:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787827159.579646:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+13:6481:x1874672580870912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827159.579654:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827159.579666:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbd36b200/0xb2e8bd65d71ddb32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb2b expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.579698:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbd36b200/0xb2e8bd65d71ddb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb2b expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.579710:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbd36b200/0xb2e8bd65d71ddb32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb2b expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.579718:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbd36b200, rc 0) 00000100:00100000:2.0:1787827159.579755:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580870912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.579767:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787827159.579799:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580870912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827159.579816:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.579826:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.579873:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.579910:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.579931:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.580118:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871040 00000100:00100000:1.0:1787827159.580127:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871040 00000100:00100000:1.0:1787827159.580172:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787827159.580181:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580871040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.580302:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580871040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.580310:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787827159.580326:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.580363:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.580431:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.580460:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.580533:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871168 00000100:00100000:1.0:1787827159.580539:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871168 00000100:00100000:1.0:1787827159.580576:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787827159.580583:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580871168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.580683:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580871168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.580701:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1787827159.580787:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.581169:0:10666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10666:1874672580871296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.581210:0:10666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.581232:0:10666:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda900 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.581254:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871296 00000100:00100000:0.0:1787827159.581258:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871296 00000100:00100000:0.0:1787827159.581290:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1787827159.581299:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:10666:x1874672580871296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.581429:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:10666:x1874672580871296:12345-0@lo:502:llog_process_th.0 Request processed in 130us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.581437:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787827159.581441:0:10666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10666:1874672580871296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787827159.581468:0:10666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787827159.581477:0:10666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787827159.581480:0:10666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787827159.581487:0:10666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8a8571b000 00000020:00000080:2.0:1787827159.581490:0:10666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787827159.581572:0:10666:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10666:1874672580871424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.581607:0:10666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.581637:0:10666:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda900 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.581659:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871424 00000100:00100000:1.0:1787827159.581665:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871424 00000100:00100000:1.0:1787827159.581718:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787827159.581728:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:10666:x1874672580871424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.581824:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:10666:x1874672580871424:12345-0@lo:502:llog_process_th.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.581833:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787827159.581873:0:10666:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10666:1874672580871424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787827159.581899:0:10666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827159.581905:0:10666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.581907:0:10666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787827159.581912:0:10666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787827159.582009:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787827159.582036:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787827159.582046:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.582057:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c0400/0xb2e8bd65d71ddb2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb32 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827159.582077:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787827159.582080:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bb88cb000 from 48 10000000:01000000:1.0:1787827159.582084:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787827159.582114:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.582123:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.582133:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.582149:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.582186:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.582223:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a86676900 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.582228:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871552 00000100:00100000:3.0:1787827159.582233:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871552 00000100:00100000:3.0:1787827159.582268:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787827159.582278:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+14:6481:x1874672580871552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.582286:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827159.582299:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8c00/0xb2e8bd65d71ddb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb39 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.582323:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8c00/0xb2e8bd65d71ddb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb39 expref: 15 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.582348:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8c00/0xb2e8bd65d71ddb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb39 expref: 15 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.582358:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8c00, rc 0) 00000100:00100000:3.0:1787827159.582429:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580871552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.582435:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787827159.582448:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827159.582467:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.582477:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.582537:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.582568:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.582590:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871680 00000100:00100000:1.0:1787827159.582594:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a86676900 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.582610:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871680 00000100:00100000:1.0:1787827159.582670:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787827159.582680:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580871680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.582819:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580871680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.582828:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787827159.582859:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.582919:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.582991:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.583026:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0dda600 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.583095:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871808 00000100:00100000:3.0:1787827159.583100:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871808 00000100:00100000:3.0:1787827159.583170:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787827159.583179:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580871808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.583349:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580871808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.583364:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787827159.583668:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580871808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.584053:0:10668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10668:1874672580871936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.584125:0:10668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.584179:0:10668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.584228:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580871936 00000100:00100000:3.0:1787827159.584234:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580871936 00000100:00100000:2.0:1787827159.584444:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787827159.584484:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:10668:x1874672580871936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.584768:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:10668:x1874672580871936:12345-0@lo:502:llog_process_th.0 Request processed in 301us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.584796:0:10668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10668:1874672580871936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.584859:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787827159.584866:0:10668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10668:1874672580872064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.584918:0:10668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.584958:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872064 00000100:00100000:2.0:1787827159.584964:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872064 00000100:00100000:3.0:1787827159.584965:0:10668:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.585016:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787827159.585029:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:10668:x1874672580872064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.585127:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:10668:x1874672580872064:12345-0@lo:502:llog_process_th.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.585135:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787827159.585143:0:10668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10668:1874672580872064:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787827159.585255:0:10668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787827159.585457:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787827159.585497:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787827159.585508:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.585521:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5cc00/0xb2e8bd65d71ddb39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb40 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827159.585533:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787827159.585536:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787827159.585539:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787827159.585573:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.585582:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.585592:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827159.585609:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.585650:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.585678:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872192 00000100:00100000:3.0:1787827159.585697:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.585712:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872192 00000100:00100000:2.0:1787827159.585797:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787827159.585818:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+15:6481:x1874672580872192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827159.585850:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787827159.585879:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbd36aa00/0xb2e8bd65d71ddb4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb47 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.585964:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbd36aa00/0xb2e8bd65d71ddb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb47 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.586069:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbd36aa00/0xb2e8bd65d71ddb4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb47 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.586140:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbd36aa00, rc 0) 00000100:00100000:2.0:1787827159.586216:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 411us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.586238:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787827159.586248:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.586265:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.586275:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827159.586361:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.586562:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.586592:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872320 00000100:00100000:3.0:1787827159.586597:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.586610:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872320 00000100:00100000:2.0:1787827159.586672:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787827159.586781:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.587214:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.587235:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.587277:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.587321:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.587328:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787827159.587346:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872448 00000100:00100000:3.0:1787827159.587403:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872448 00000100:00100000:3.0:1787827159.587434:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787827159.587441:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.587523:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.587531:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787827159.587574:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.587587:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.588056:0:10670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10670:1874672580872576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.588099:0:10670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.588133:0:10670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.588141:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872576 00000100:00100000:1.0:1787827159.588152:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872576 00000100:00100000:1.0:1787827159.588215:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787827159.588232:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10670:x1874672580872576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.588479:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10670:x1874672580872576:12345-0@lo:502:llog_process_th.0 Request processed in 248us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.588485:0:10670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10670:1874672580872576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.588498:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000020:01000000:3.0:1787827159.588533:0:10670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827159.588547:0:10670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.588552:0:10670:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787827159.588561:0:10670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787827159.588594:0:10670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10670:1874672580872704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.588637:0:10670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.588661:0:10670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.588681:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872704 00000100:00100000:1.0:1787827159.588698:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872704 00000100:00100000:1.0:1787827159.588732:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787827159.588742:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10670:x1874672580872704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.588839:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:10670:x1874672580872704:12345-0@lo:502:llog_process_th.0 Request processed in 96us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.588846:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787827159.588851:0:10670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10670:1874672580872704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787827159.588874:0:10670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827159.588878:0:10670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.588879:0:10670:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787827159.588883:0:10670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1787827159.588961:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787827159.589006:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787827159.589017:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.589026:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8200/0xb2e8bd65d71ddb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb4e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827159.589036:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787827159.589038:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8bb88cb000 from 4 10000000:01000000:1.0:1787827159.589049:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787827159.589081:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.589089:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.589097:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.589117:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.589162:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.589197:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a86676f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.589234:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872832 00000100:00100000:3.0:1787827159.589241:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872832 00000100:00100000:3.0:1787827159.589288:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787827159.589301:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+16:6481:x1874672580872832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.589315:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827159.589332:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71ddb5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb55 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.589357:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71ddb5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb55 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.589369:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8400/0xb2e8bd65d71ddb5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb55 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.589407:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8400, rc 0) 00000100:00100000:3.0:1787827159.589480:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580872832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.589488:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.589497:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:1.0:1787827159.589515:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.589529:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.589588:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.589624:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.589660:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a86676f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.589700:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580872960 00000100:00100000:3.0:1787827159.589707:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580872960 00000100:00100000:3.0:1787827159.589747:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787827159.589766:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580872960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.589914:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580872960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.589922:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787827159.589966:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580872960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.590007:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.590061:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.590085:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.590126:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873088 00000100:00100000:2.0:1787827159.590132:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873088 00000100:00100000:2.0:1787827159.590168:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787827159.590178:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580873088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.590278:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580873088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.590287:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787827159.590289:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.590603:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10671:1874672580873216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.590643:0:10671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.590671:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873216 00000100:00100000:3.0:1787827159.590676:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873216 00000100:00100000:3.0:1787827159.590727:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787827159.590735:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10671:x1874672580873216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.590816:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10671:x1874672580873216:12345-0@lo:502:llog_process_th.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.590823:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787827159.590866:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a8750c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.590949:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10671:1874672580873216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787827159.590973:0:10671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827159.590984:0:10671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.590986:0:10671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787827159.590993:0:10671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8bb88cb000 00000020:00000080:3.0:1787827159.591002:0:10671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787827159.591090:0:10671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10671:1874672580873344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.591146:0:10671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.591167:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873344 00000100:00100000:3.0:1787827159.591171:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873344 00000100:00100000:3.0:1787827159.591193:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787827159.591198:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10671:x1874672580873344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.591256:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:10671:x1874672580873344:12345-0@lo:502:llog_process_th.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.591263:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787827159.591293:0:10671:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.591305:0:10671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10671:1874672580873344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787827159.591328:0:10671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827159.591332:0:10671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.591334:0:10671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787827159.591338:0:10671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787827159.591417:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787827159.591436:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827159.591446:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591457:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c000/0xb2e8bd65d71ddb55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb5c expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827159.591468:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787827159.591471:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8bba965800 from 48 10000000:01000000:3.0:1787827159.591474:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787827159.591498:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591517:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591527:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827159.591541:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.591568:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.591589:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.591600:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873472 00000100:00100000:3.0:1787827159.591604:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873472 00000100:00100000:3.0:1787827159.591682:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787827159.591703:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+17:6481:x1874672580873472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.591712:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827159.591726:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9200/0xb2e8bd65d71ddb6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb63 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591748:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9200/0xb2e8bd65d71ddb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb63 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591759:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9200/0xb2e8bd65d71ddb6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb63 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591769:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9200, rc 0) 00000100:00100000:3.0:1787827159.591807:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580873472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.591814:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787827159.591868:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.591896:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.591906:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827159.591956:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.591985:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.592121:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873600 00000100:00100000:3.0:1787827159.592132:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.592133:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873600 00000100:00100000:2.0:1787827159.592200:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787827159.592211:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580873600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.592446:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580873600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.592456:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787827159.592518:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.592558:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.592614:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.592653:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873728 00000100:00100000:3.0:1787827159.592658:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.592660:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873728 00000100:00100000:2.0:1787827159.592723:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787827159.592738:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580873728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.592855:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580873728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.592862:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787827159.592869:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580873728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.593118:0:10672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10672:1874672580873856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.593167:0:10672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.593190:0:10672:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.593206:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873856 00000100:00100000:2.0:1787827159.593221:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873856 00000100:00100000:2.0:1787827159.593278:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787827159.593291:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10672:x1874672580873856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.593447:0:10672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10672:1874672580873856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.593450:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10672:x1874672580873856:12345-0@lo:502:llog_process_th.0 Request processed in 158us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.593463:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787827159.593510:0:10672:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10672:1874672580873984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.593565:0:10672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.593609:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580873984 00000100:00100000:2.0:1787827159.593617:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580873984 00000100:00100000:3.0:1787827159.593619:0:10672:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b85150000 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.593660:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787827159.593668:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10672:x1874672580873984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.593774:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:10672:x1874672580873984:12345-0@lo:502:llog_process_th.0 Request processed in 104us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.593781:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787827159.593791:0:10672:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10672:1874672580873984:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787827159.593827:0:10672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787827159.593903:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787827159.593944:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827159.593955:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.593967:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa8600/0xb2e8bd65d71ddb63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb6a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827159.593977:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787827159.593979:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787827159.593982:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787827159.594012:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.594018:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.594032:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.594049:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.594083:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.594111:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.594116:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874112 00000100:00100000:3.0:1787827159.594123:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874112 00000100:00100000:3.0:1787827159.594178:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787827159.594193:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+18:6481:x1874672580874112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.594206:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827159.594222:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71ddb78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb71 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.594246:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71ddb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb71 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.594257:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa9e00/0xb2e8bd65d71ddb78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb71 expref: 19 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.594266:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa9e00, rc 0) 00000100:00100000:3.0:1787827159.594317:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.594326:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787827159.594347:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827159.594375:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.594422:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.594494:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.594547:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.594616:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.594634:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874240 00000100:00100000:2.0:1787827159.594638:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874240 00000100:00100000:2.0:1787827159.594671:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787827159.594678:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.594779:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.594787:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787827159.594843:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.594890:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.594945:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.594971:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.594977:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874368 00000100:00100000:2.0:1787827159.594985:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874368 00000100:00100000:2.0:1787827159.595022:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787827159.595041:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.595119:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.595128:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787827159.595165:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.595451:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10673:1874672580874496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.595498:0:10673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.595531:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874496 00000100:00100000:3.0:1787827159.595533:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.595538:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874496 00000100:00100000:0.0:1787827159.595585:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787827159.595596:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:10673:x1874672580874496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.595741:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b8b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:10673:x1874672580874496:12345-0@lo:502:llog_process_th.0 Request processed in 148us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.595748:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787827159.595754:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10673:1874672580874496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787827159.595781:0:10673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787827159.595791:0:10673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.595794:0:10673:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787827159.595801:0:10673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787827159.595828:0:10673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10673:1874672580874624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.595872:0:10673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.595902:0:10673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b85150000 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.595916:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874624 00000100:00100000:0.0:1787827159.595925:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874624 00000100:00100000:0.0:1787827159.595969:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787827159.595982:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:10673:x1874672580874624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.596085:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:10673:x1874672580874624:12345-0@lo:502:llog_process_th.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.596094:0:10673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10673:1874672580874624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.596097:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:01000000:3.0:1787827159.596134:0:10673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787827159.596139:0:10673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787827159.596141:0:10673:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787827159.596146:0:10673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1787827159.596219:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1787827159.596271:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1787827159.596282:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.596293:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36bc00/0xb2e8bd65d71ddb71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb78 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787827159.596303:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787827159.596307:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8bba965800 from 4 10000000:01000000:0.0:1787827159.596310:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787827159.596337:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.596346:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.596355:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.596415:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.596461:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.596491:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874752 00000100:00100000:0.0:1787827159.596496:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.596497:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874752 00000100:00100000:3.0:1787827159.596528:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787827159.596538:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+19:6481:x1874672580874752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787827159.596546:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787827159.596560:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71ddb86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb7f expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.596581:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71ddb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb7f expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.596591:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8bbcfa8e00/0xb2e8bd65d71ddb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb7f expref: 20 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.596600:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8bbcfa8e00, rc 0) 00000100:00100000:3.0:1787827159.596641:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580874752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.596647:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787827159.596653:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827159.596671:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.596682:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787827159.596763:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.596797:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.596816:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.596819:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580874880 00000100:00100000:3.0:1787827159.596824:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580874880 00000100:00100000:3.0:1787827159.596855:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787827159.596864:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580874880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.596965:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580874880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.596979:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580874880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.596984:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787827159.597026:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.597074:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.597099:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bb88683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.597138:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875008 00000100:00100000:1.0:1787827159.597148:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875008 00000100:00100000:1.0:1787827159.597195:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787827159.597206:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580875008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.597336:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580875008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.597354:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787827159.597368:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.597698:0:10675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10675:1874672580875136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.597746:0:10675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.597775:0:10675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a81587c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.597798:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875136 00000100:00100000:1.0:1787827159.597805:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875136 00000100:00100000:1.0:1787827159.597854:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787827159.597865:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10675:x1874672580875136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.597973:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10675:x1874672580875136:12345-0@lo:502:llog_process_th.0 Request processed in 111us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.597981:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787827159.598010:0:10675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10675:1874672580875136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787827159.598044:0:10675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787827159.598060:0:10675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787827159.598062:0:10675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787827159.598071:0:10675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8bba965800 00000020:00000080:0.0:1787827159.598074:0:10675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787827159.598143:0:10675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10675:1874672580875264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.598177:0:10675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.598202:0:10675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a81587c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.598256:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875264 00000100:00100000:2.0:1787827159.598262:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875264 00000100:00100000:2.0:1787827159.598338:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787827159.598349:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10675:x1874672580875264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.598501:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:10675:x1874672580875264:12345-0@lo:502:llog_process_th.0 Request processed in 154us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.598509:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787827159.598555:0:10675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10675:1874672580875264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787827159.598596:0:10675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827159.598604:0:10675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827159.598607:0:10675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787827159.598619:0:10675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787827159.598752:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787827159.598796:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787827159.598805:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.598814:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8a865c1000/0xb2e8bd65d71ddb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb86 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827159.598821:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787827159.598824:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f8b98781000 from 48 10000000:01000000:2.0:1787827159.598826:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787827159.598852:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.598860:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.598871:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.598895:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.598931:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.599010:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.599048:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875392 00000100:00100000:0.0:1787827159.599054:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875392 00000100:00100000:0.0:1787827159.599094:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787827159.599103:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+20:6481:x1874672580875392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827159.599111:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827159.599126:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c1800/0xb2e8bd65d71ddb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb8d expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.599148:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c1800/0xb2e8bd65d71ddb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb8d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.599159:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c1800/0xb2e8bd65d71ddb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb8d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.599167:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c1800, rc 0) 00000100:00100000:0.0:1787827159.599211:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580875392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.599219:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787827159.599249:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827159.599267:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.599279:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddb94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.599337:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.599369:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.599424:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875520 00000100:00100000:2.0:1787827159.599427:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.599429:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875520 00000100:00100000:0.0:1787827159.599461:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787827159.599470:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580875520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.599582:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580875520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.599587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787827159.599613:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.599646:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.599685:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.599715:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8ba0ddad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.599723:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875648 00000100:00100000:0.0:1787827159.599728:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875648 00000100:00100000:0.0:1787827159.599759:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787827159.599766:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580875648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.599841:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580875648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.599850:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580875648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.599851:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787827159.600111:0:10676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10676:1874672580875776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.600149:0:10676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827159.600166:0:10676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbcebde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.600182:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875776 00000100:00100000:2.0:1787827159.600188:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875776 00000100:00100000:2.0:1787827159.600221:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787827159.600231:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10676:x1874672580875776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.600314:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10676:x1874672580875776:12345-0@lo:502:llog_process_th.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.600328:0:10676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10676:1874672580875776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.600335:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787827159.600401:0:10676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10676:1874672580875904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.600442:0:10676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.600464:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580875904 00000100:00100000:0.0:1787827159.600468:0:10676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a87577b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.600470:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580875904 00000100:00100000:2.0:1787827159.600501:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787827159.600510:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10676:x1874672580875904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.600594:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:10676:x1874672580875904:12345-0@lo:502:llog_process_th.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.600601:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787827159.600604:0:10676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10676:1874672580875904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787827159.600629:0:10676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787827159.600674:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787827159.600712:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787827159.600721:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.600731:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36be00/0xb2e8bd65d71ddb8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddb94 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787827159.600739:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787827159.600741:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1787827159.600745:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787827159.600767:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.600774:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.600782:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.600796:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.600836:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.600855:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b864310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.600860:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876032 00000100:00100000:0.0:1787827159.600865:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876032 00000100:00100000:0.0:1787827159.600897:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787827159.600907:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+21:6481:x1874672580876032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827159.600916:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827159.600935:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddb9b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.600955:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb9b expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.600966:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c1400/0xb2e8bd65d71ddba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddb9b expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.600972:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c1400, rc 0) 00000100:00100000:0.0:1787827159.601007:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.601014:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787827159.601017:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787827159.601034:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787827159.601052:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787827159.601105:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787827159.601136:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.601151:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b864310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.601355:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876160 00000100:00100000:0.0:1787827159.601360:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876160 00000100:00100000:0.0:1787827159.601413:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787827159.601421:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.601513:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.601521:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787827159.601530:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.601565:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.601607:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.601635:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913240 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.601650:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876288 00000100:00100000:1.0:1787827159.601654:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876288 00000100:00100000:1.0:1787827159.601685:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787827159.601707:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.601797:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8babfae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.601805:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787827159.601812:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787827159.602491:0:10677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10677:1874672580876416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.602540:0:10677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827159.602591:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876416 00000100:00100000:0.0:1787827159.602592:0:10677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a87577000 going to sleep for 11 seconds 00000100:00100000:2.0:1787827159.602606:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876416 00000100:00100000:2.0:1787827159.602680:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787827159.602711:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:10677:x1874672580876416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787827159.602894:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:10677:x1874672580876416:12345-0@lo:502:llog_process_th.0 Request processed in 202us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827159.602904:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787827159.602916:0:10677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b9299d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10677:1874672580876416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787827159.602959:0:10677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827159.602970:0:10677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827159.602973:0:10677:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787827159.602986:0:10677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787827159.603009:0:10677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10677:1874672580876544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.603060:0:10677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.603082:0:10677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.603087:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876544 00000100:00100000:0.0:1787827159.603093:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876544 00000100:00100000:0.0:1787827159.603134:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787827159.603145:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:10677:x1874672580876544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787827159.603270:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:10677:x1874672580876544:12345-0@lo:502:llog_process_th.0 Request processed in 125us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.603282:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787827159.603614:0:10677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10677:1874672580876544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787827159.603644:0:10677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827159.603649:0:10677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827159.603651:0:10677:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787827159.603658:0:10677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787827159.603761:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1787827159.603795:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787827159.603806:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.603818:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbd36a600/0xb2e8bd65d71ddb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddba2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787827159.603828:0:6481:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787827159.603832:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f8b98781000 from 4 10000000:01000000:1.0:1787827159.603835:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787827159.603864:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.603873:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.603883:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.603906:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.603940:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.603971:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913240 going to sleep for 11 seconds 00000100:00100000:0.0:1787827159.604317:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876672 00000100:00100000:0.0:1787827159.604323:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876672 00000100:00100000:0.0:1787827159.604368:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787827159.604402:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+22:6481:x1874672580876672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787827159.604411:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787827159.604426:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71ddbb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddba9 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.604446:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71ddbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddba9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.604454:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8a865c0000/0xb2e8bd65d71ddbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddba9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787827159.604462:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8a865c0000, rc 0) 00000100:00100000:0.0:1787827159.604501:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580876672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827159.604509:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787827159.604520:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827159.604533:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbb0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.604542:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddbb0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.604601:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.604632:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.604659:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.604664:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876800 00000100:00100000:3.0:1787827159.604669:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876800 00000100:00100000:3.0:1787827159.604710:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787827159.604719:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580876800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.604823:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580876800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.604829:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787827159.604859:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.604898:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.604946:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.604971:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf913240 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.604983:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580876928 00000100:00100000:3.0:1787827159.604989:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580876928 00000100:00100000:3.0:1787827159.605020:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787827159.605033:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580876928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.605121:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580876928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.605127:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787827159.605139:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580876928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.605567:0:10679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10679:1874672580877056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.605622:0:10679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.605658:0:10679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf9136c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787827159.605664:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877056 00000100:00100000:3.0:1787827159.605671:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877056 00000100:00100000:3.0:1787827159.605902:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787827159.605913:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10679:x1874672580877056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787827159.605998:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10679:x1874672580877056:12345-0@lo:502:llog_process_th.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827159.606004:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787827159.606011:0:10679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10679:1874672580877056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787827159.606042:0:10679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787827159.606059:0:10679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827159.606062:0:10679:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787827159.606072:0:10679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f8b98781000 00000020:00000080:1.0:1787827159.606076:0:10679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787827159.606157:0:10679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10679:1874672580877184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.606206:0:10679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.606228:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877184 00000100:00100000:1.0:1787827159.606233:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877184 00000100:00100000:1.0:1787827159.606260:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787827159.606269:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10679:x1874672580877184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787827159.606341:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:10679:x1874672580877184:12345-0@lo:502:llog_process_th.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.606349:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787827159.606423:0:10679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8a81587180 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.606436:0:10679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a7d14451-881f-46a5-81e7-5eca8cfcf000:10679:1874672580877184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787827159.606451:0:10679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787827159.606455:0:10679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787827159.606457:0:10679:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787827159.606461:0:10679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787827159.606554:0:6481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787827159.606589:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787827159.606599:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbb0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.606623:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8b85e5c200/0xb2e8bd65d71ddba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbb0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787827159.606633:0:6481:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787827159.606636:0:6481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f8b988b19b8 from 1 10000000:01000000:3.0:1787827159.606639:0:6481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787827159.606661:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.606667:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.606673:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787827159.606682:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580877312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787827159.606726:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827159.606745:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8b861a8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.606760:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877312 00000100:00100000:1.0:1787827159.606765:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877312 00000100:00100000:1.0:1787827159.606802:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787827159.606812:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+23:6481:x1874672580877312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827159.606822:0:7426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787827159.606837:0:7426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f8b85e5d400/0xb2e8bd65d71ddbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb2e8bd65d71ddbb7 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.606859:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f8b85e5d400/0xb2e8bd65d71ddbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddbb7 expref: 24 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.606875:0:7426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f8b85e5d400/0xb2e8bd65d71ddbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb2e8bd65d71ddbb7 expref: 24 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.606882:0:7426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f8b85e5d400, rc 0) 00000100:00100000:1.0:1787827159.606912:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580877312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827159.606919:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787827159.606955:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580877312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787827159.606969:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.606980:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb2e8bd65d71ddbbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787827159.607024:0:6481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580877440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.607051:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827159.607073:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877440 00000100:00100000:1.0:1787827159.607077:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877440 00000100:00100000:1.0:1787827159.607107:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787827159.607115:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580877440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787827159.607172:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:6481:x1874672580877440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (120us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787827159.607178:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787827159.607199:0:6481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f8bbf9136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787827159.607210:0:6481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a7d14451-881f-46a5-81e7-5eca8cfcf000:6481:1874672580877440:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787827159.607240:0:6481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787827159.607244:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787827159.607251:0:6481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8f8bbcfa9c00/0xb2e8bd65d71ddbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb2e8bd65d71ddbbe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787827159.702511:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827160.470516:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787827160.470545:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580877568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827160.470631:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827160.470717:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877568 00000100:00100000:3.0:1787827160.470726:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877568 00000100:00080000:2.0:1787827160.470895:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787827160.470995:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787827160.471006:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd1db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580877568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787827160.471040:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827160.471092:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd1db840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580877568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827160.471106:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787827160.471224:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1db480 x1874672580877568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827160.471245:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580877568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827160.471352:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787827160.471364:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580877696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827160.471420:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827160.471455:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877696 00000100:00100000:1.0:1787827160.471461:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877696 00000100:00100000:1.0:1787827160.471534:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787827160.471543:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b9299f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580877696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787827160.471557:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827160.471608:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b9299f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580877696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827160.471617:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787827160.471642:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787827160.471694:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf9c6940 x1874672580877696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827160.471712:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580877696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787827160.726475:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787827160.982535:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580877824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827160.982609:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827160.982655:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877824 00000100:00100000:2.0:1787827160.982663:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877824 00000100:00100000:2.0:1787827160.982723:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787827160.982731:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580877824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787827160.982762:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787827160.982821:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580877824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827160.982874:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580877824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827160.983251:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787827160.983489:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580877952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787827160.983526:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827160.983551:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580877952 00000100:00100000:2.0:1787827160.983557:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580877952 00000100:00100000:2.0:1787827160.983588:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787827160.983596:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580877952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787827160.983614:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787827160.983655:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580877952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827160.983662:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787827160.983704:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580877952:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787827161.040776:0:10903:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing yml_node 00000100:00100000:1.0:1787827161.297507:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827161.297543:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827161.297566:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827161.297592:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438784 00000100:00100000:1.0:1787827161.297593:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827161.297601:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438784 00000100:00100000:2.0:1787827161.297632:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439040 00000100:00100000:2.0:1787827161.297637:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439040 00000100:00100000:3.0:1787827161.297656:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 265 00000100:00100000:3.0:1787827161.297669:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2397:x1874672572438784:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827161.297700:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1787827161.297710:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572439040:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827161.297757:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572439040:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.297764:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827161.297770:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1787827161.297787:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572438912 00000100:00100000:2.0:1787827161.297791:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572438912 00000100:00100000:2.0:1787827161.297822:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787827161.297831:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572438912:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827161.297866:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2396:x1874672572438912:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.297873:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1787827161.297908:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439296 00000100:00100000:1.0:1787827161.297913:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439296 00000100:00080000:2.0:1787827161.297937:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787827161.297943:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787827161.297945:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439168 00000100:00080000:2.0:1787827161.297946:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787827161.297948:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439168 00000100:00080000:2.0:1787827161.297958:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787827161.297972:0:9452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:1.0:1787827161.297980:0:9452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572439296:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827161.297995:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1787827161.298005:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572439168:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787827161.298015:0:9452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572439296:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 35us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.298022:0:9452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1787827161.298041:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572439168:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827161.298049:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787827161.298189:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2397:x1874672572438784:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.298199:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 265 00000100:00100000:3.0:1787827161.494613:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580878080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827161.494718:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.494788:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580878592:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.494821:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.494846:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580879104:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.494877:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.494900:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580879616:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.494923:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.494953:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787827161.494960:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580878208:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.494995:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.495025:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672580878720:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495069:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.495071:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878208 00000100:00100000:1.0:1787827161.495081:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878208 00000100:00100000:0.0:1787827161.495094:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878080 00000100:00100000:3.0:1787827161.495094:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580879232:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495101:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878080 00000100:00100000:1.0:1787827161.495135:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787827161.495142:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.495148:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3615:x1874672580878208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495158:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787827161.495168:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580879744:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495172:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580878080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787827161.495203:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827161.495210:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.495217:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3615:x1874672580878208:12345-0@lo:400:kworker.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495225:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787827161.495259:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580878208:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495261:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580878080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.495271:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787827161.495285:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1d83c0 x1874672580878080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.495287:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580878336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495303:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00080000:0.0:1787827161.495304:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787827161.495322:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827161.495333:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580878464:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495333:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580878080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827161.495348:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580878848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495373:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878592 00000100:00100000:0.0:1787827161.495404:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.495416:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878592 00000100:00100000:3.0:1787827161.495456:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878464 00000100:00100000:3.0:1787827161.495460:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878464 00000100:00100000:3.0:1787827161.495479:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787827161.495486:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.495552:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827161.495566:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580878976:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495579:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580878592:12345-0@lo:400:kworker.0 Request processed in 92us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495585:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580879360:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495591:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787827161.495603:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.495613:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787827161.495624:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580878464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.495628:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878720 00000100:00100000:1.0:1787827161.495634:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878720 00000100:00100000:0.0:1787827161.495643:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1874672580879488:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495660:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b867f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580878464:12345-0@lo:400:kworker.0 Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495670:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878336 00000100:00100000:1.0:1787827161.495685:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878336 00000100:00100000:0.0:1787827161.495691:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.495695:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787827161.495708:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878848 00000100:00100000:1.0:1787827161.495718:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878848 00000100:00100000:3.0:1787827161.495722:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879104 00000100:00100000:0.0:1787827161.495726:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580878464:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495735:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879104 00000100:00100000:1.0:1787827161.495756:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580878976 00000100:00100000:1.0:1787827161.495761:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580878976 00000100:00100000:0.0:1787827161.495762:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879488 00000100:00100000:0.0:1787827161.495768:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879488 00000100:00100000:3.0:1787827161.495773:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879616 00000100:00100000:3.0:1787827161.495779:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879616 00000100:00100000:1.0:1787827161.495791:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787827161.495799:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1874672580878720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495803:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879232 00000100:00100000:3.0:1787827161.495807:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879232 00000100:00100000:0.0:1787827161.495809:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787827161.495821:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580878336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.495838:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1874672580878720:12345-0@lo:400:kworker.0 Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.495841:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879744 00000100:00100000:3.0:1787827161.495847:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879744 00000100:00100000:1.0:1787827161.495849:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787827161.495871:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580878336:12345-0@lo:400:kworker.0 Request processed in 51us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495871:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787827161.495879:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787827161.495885:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580878848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495886:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787827161.495894:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580879104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.495909:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787827161.495930:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580878976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827161.495931:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580878848:12345-0@lo:400:kworker.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495946:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787827161.495946:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580879104:12345-0@lo:400:kworker.0 Request processed in 54us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.495955:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787827161.495969:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787827161.495973:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787827161.495986:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580878976:12345-0@lo:400:kworker.0 Request processed in 57us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.495987:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1874672580879488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.495987:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580879616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.496001:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787827161.496029:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827161.496034:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580879616:12345-0@lo:400:kworker.0 Request processed in 51us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827161.496038:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1874672580879488:12345-0@lo:400:kworker.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827161.496047:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787827161.496052:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787827161.496056:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580879872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827161.496069:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787827161.496072:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879360 00000100:00100000:1.0:1787827161.496076:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879360 00000100:00100000:3.0:1787827161.496080:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580879232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.496090:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827161.496102:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787827161.496112:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580879360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.496127:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580879232:12345-0@lo:400:kworker.0 Request processed in 49us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.496135:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1da580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580878336:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.496136:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787827161.496150:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580879360:12345-0@lo:400:kworker.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.496160:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580878848:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.496162:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787827161.496163:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787827161.496178:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580879744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.496184:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580879360:0@lo:400:kworker.0 00000100:00080000:1.0:1787827161.496195:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827161.496201:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827161.496211:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827161.496221:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580879872 00000100:00100000:3.0:1787827161.496223:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580879744:12345-0@lo:400:kworker.0 Request processed in 48us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.496226:0:10314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580879872 00000100:00100000:3.0:1787827161.496234:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787827161.496251:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1db480 x1874672580878976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.496263:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580878976:0@lo:400:kworker.0 00000100:00100000:0.0:1787827161.496264:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787827161.496279:0:10314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580879872:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787827161.496284:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a4000 x1874672580879488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.496294:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1874672580879488:0@lo:400:kworker.0 00002000:00000024:0.0:1787827161.496295:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827161.496337:0:10314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580879872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827161.496344:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787827161.496353:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf9c43c0 x1874672580879872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827161.496361:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787827161.496376:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580879872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827161.496426:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1874672580878720:0@lo:400:kworker.0 00010000:00080000:3.0:1787827161.496444:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a865ae940 x1874672580879232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827161.496455:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a865ae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580879232:0@lo:400:kworker.0 00010000:00080000:3.0:1787827161.496470:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a6580 x1874672580879744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827161.496477:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580879744:0@lo:400:kworker.0 00000100:00100000:3.0:1787827161.496486:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580878592:0@lo:400:kworker.0 00010000:00080000:3.0:1787827161.496497:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd1d8000 x1874672580879104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827161.496503:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580879104:0@lo:400:kworker.0 00010000:00080000:3.0:1787827161.496509:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a70c0 x1874672580879616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827161.496514:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580879616:0@lo:400:kworker.0 00010000:00010000:1.0:1787827161.750543:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827162.730365:0:11086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.65 00010000:00010000:0.0:1787827162.774499:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827163.635459:0:11184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.65 00010000:00010000:0.0:1787827163.799491:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787827164.478492:0:11281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.65 00010000:00010000:2.0:1787827164.822533:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827165.028524:0:11329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-sec ============----- Thu Aug 27 06:39:23 EDT 2026 00000100:00100000:2.0:1787827165.590600:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787827165.590621:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787827165.590629:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580880000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787827165.590642:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580880128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827165.590713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827165.590763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827165.590782:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880128 00000100:00100000:3.0:1787827165.590794:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880128 00000100:00100000:0.0:1787827165.590825:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880000 00000100:00080000:2.0:1787827165.590841:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827165.590842:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880000 00000100:00100000:3.0:1787827165.590891:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787827165.590901:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787827165.590904:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580880128:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827165.590919:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580880000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787827165.590939:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787827165.590942:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827165.591028:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580880000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827165.591037:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580880128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827165.591046:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787827165.591073:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787827165.591084:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a4b40 x1874672580880128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787827165.591085:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf9c5a40 x1874672580880000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827165.591119:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580880000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787827165.591132:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580880128:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787827165.846469:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827166.102544:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787827166.102601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827166.102661:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880256 00000100:00100000:0.0:1787827166.102667:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880256 00000100:00100000:0.0:1787827166.102713:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787827166.102724:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580880256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787827166.102750:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787827166.102801:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580880256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.102808:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787827166.102838:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787827166.103472:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580880384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827166.103501:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.103560:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880384 00000100:00100000:1.0:1787827166.103564:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880384 00000100:00100000:1.0:1787827166.103589:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787827166.103595:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580880384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787827166.103620:0:6490:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787827166.103668:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580880384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.103673:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787827166.103697:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580880384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827166.416421:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827166.416463:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439552 00000100:00100000:0.0:1787827166.416478:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787827166.416481:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439552 00000100:00100000:0.0:1787827166.416512:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827166.416524:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439424 00000100:00100000:3.0:1787827166.416530:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439424 00000100:00100000:1.0:1787827166.416539:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439680 00000100:00100000:1.0:1787827166.416543:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439680 00000100:00100000:0.0:1787827166.416552:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827166.416573:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 267 00000100:00100000:1.0:1787827166.416577:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1787827166.416590:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2395:x1874672572439424:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787827166.416591:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2394:x1874672572439552:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827166.416604:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827166.416633:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1787827166.416659:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2395:x1874672572439680:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787827166.416674:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2394:x1874672572439552:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827166.416676:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2395:x1874672572439424:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.416695:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1787827166.416695:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 267 00000100:00100000:0.0:1787827166.416709:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92a0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2395:x1874672572439680:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.416719:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00080000:1.0:1787827166.416725:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827166.416731:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827166.416745:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439808 00000100:00100000:3.0:1787827166.416749:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439808 00000100:00100000:0.0:1787827166.416784:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572439936 00000100:00100000:0.0:1787827166.416790:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572439936 00000100:00100000:3.0:1787827166.416797:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1787827166.416807:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b9299d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2394:x1874672572439808:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827166.416833:0:9452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787827166.416841:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b9299d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2394:x1874672572439808:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.416846:0:9452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2395:x1874672572439936:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787827166.416859:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:1.0:1787827166.416860:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827166.416864:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827166.416891:0:9452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2395:x1874672572439936:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.416899:0:9452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1787827166.614482:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580880512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827166.614547:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827166.614603:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880512 00000100:00100000:2.0:1787827166.614615:0:10314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880512 00000100:00080000:1.0:1787827166.614668:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827166.614706:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787827166.614721:0:10314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a865ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580880512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787827166.614756:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827166.614840:0:10314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a865ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580880512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.614848:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787827166.614867:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf9c43c0 x1874672580880512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827166.614883:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580880512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827166.615476:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580880768:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.615476:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a87565a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580880640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827166.615534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.615534:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.615585:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580881152:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.615589:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580881280:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.615623:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.615623:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827166.615637:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580880896:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.615659:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580881664:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.615660:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580881792:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.615694:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.615732:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827166.615732:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827166.615743:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880768 00000100:00100000:0.0:1787827166.615749:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880768 00000100:00100000:1.0:1787827166.615781:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880640 00000100:00100000:2.0:1787827166.615784:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580881408:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.615786:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880640 00000100:00100000:0.0:1787827166.615791:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787827166.615806:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3616:x1874672580880768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.615823:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787827166.615832:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580880640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787827166.615845:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827166.615869:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827166.615881:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa988450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3616:x1874672580880768:12345-0@lo:400:kworker.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.615884:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580880640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.615892:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787827166.615892:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787827166.615908:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580881920:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.615920:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881792 00000100:00100000:0.0:1787827166.615926:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881152 00000100:00100000:1.0:1787827166.615926:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881792 00000100:00100000:0.0:1787827166.615929:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881152 00000100:00100000:2.0:1787827166.615951:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.615957:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881664 00000100:00100000:0.0:1787827166.615960:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787827166.615961:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881664 00000100:00100000:0.0:1787827166.615970:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.615987:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787827166.616000:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580881024:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.616001:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787827166.616014:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87566940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616018:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580881152:12345-0@lo:400:kworker.0 Request processed in 52us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.616024:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787827166.616046:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881280 00000100:00100000:0.0:1787827166.616052:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881280 00000100:00100000:2.0:1787827166.616053:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.616063:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87566940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580881792:12345-0@lo:400:kworker.0 Request processed in 48us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.616072:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787827166.616086:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580880896 00000100:00100000:1.0:1787827166.616088:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787827166.616089:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580880896 00000100:00100000:1.0:1787827166.616096:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616104:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881408 00000100:00100000:2.0:1787827166.616107:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580881536:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616109:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881408 00000100:00100000:1.0:1787827166.616129:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580881664:12345-0@lo:400:kworker.0 Request processed in 34us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.616134:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881920 00000100:00100000:0.0:1787827166.616137:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881920 00000100:00100000:1.0:1787827166.616137:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787827166.616162:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787827166.616163:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787827166.616165:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787827166.616170:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616172:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827166.616183:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580881152:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616202:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580882048:0@lo:400:kworker.0 00010000:00080000:1.0:1787827166.616207:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40c000 x1874672580881664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827166.616220:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580881664:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616227:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87567c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580881280:12345-0@lo:400:kworker.0 Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.616234:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787827166.616234:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a87565a40 x1874672580880640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827166.616254:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a87565a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580880640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787827166.616257:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881536 00000100:00100000:2.0:1787827166.616261:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827166.616263:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881536 00000100:00100000:0.0:1787827166.616309:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882048 00000100:00100000:0.0:1787827166.616313:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882048 00000100:00100000:1.0:1787827166.616313:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580881024 00000100:00100000:1.0:1787827166.616316:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580881024 00000100:00100000:2.0:1787827166.616334:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787827166.616342:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787827166.616343:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787827166.616348:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a867261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616365:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86727c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580881408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.616365:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8b92b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616450:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a867261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580880896:12345-0@lo:400:kworker.0 Request processed in 104us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827166.616460:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86727c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580881408:12345-0@lo:400:kworker.0 Request processed in 98us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.616462:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8b92b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1874672580881024:12345-0@lo:400:kworker.0 Request processed in 97us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.616470:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787827166.616475:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787827166.616477:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787827166.616513:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787827166.616523:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787827166.616529:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580881920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616539:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf971e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580881536:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787827166.616549:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40ed00 x1874672580881792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827166.616559:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580881792:0@lo:400:kworker.0 00000100:00100000:1.0:1787827166.616576:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580881280:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616592:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86727840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580881920:12345-0@lo:400:kworker.0 Request processed in 68us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827166.616594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580880768:0@lo:400:kworker.0 00000100:00100000:0.0:1787827166.616601:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf971e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1874672580881536:12345-0@lo:400:kworker.0 Request processed in 64us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.616625:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787827166.616633:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787827166.616669:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787827166.616682:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf9712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580882048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787827166.616687:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827166.616729:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf9712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580882048:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827166.616749:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787827166.616796:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1874672580881024:0@lo:400:kworker.0 00010000:00080000:2.0:1787827166.616815:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40c780 x1874672580881536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827166.616825:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1874672580881536:0@lo:400:kworker.0 00010000:00080000:2.0:1787827166.616841:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a86725680 x1874672580882048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827166.616850:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580882048:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616863:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580880896:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616879:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580881408:0@lo:400:kworker.0 00000100:00100000:2.0:1787827166.616892:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580881920:0@lo:400:kworker.0 00010000:00010000:0.0:1787827166.870472:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827167.894559:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827168.918501:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787827169.942523:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787827170.410343:0:12054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 27 66 00000100:00100000:0.0:1787827170.710531:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a87564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580882304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827170.710531:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580882176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787827170.710599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827170.710651:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882176 00000100:00100000:0.0:1787827170.710658:0:10314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882176 00000100:00100000:2.0:1787827170.710670:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787827170.710695:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827170.710712:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882304 00000100:00100000:0.0:1787827170.710716:0:10314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882304 00000100:00100000:2.0:1787827170.710722:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787827170.710733:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580882176:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787827170.710742:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787827170.710747:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787827170.710756:0:10314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf970780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580882304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827170.710761:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787827170.710768:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827170.710825:0:10314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf970780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580882304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827170.710831:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874672580882176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827170.710837:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787827170.710839:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a87564b40 x1874672580882304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827170.710847:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787827170.710860:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a87564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580882304:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787827170.710942:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a61c0 x1874672580882176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827170.710959:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1874672580882176:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787827170.891691:0:12103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 26 00010000:00010000:0.0:1787827170.966466:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827171.222546:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580882560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827171.222567:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580882432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827171.222601:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.222668:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827171.222668:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882560 00000100:00100000:1.0:1787827171.222676:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882560 00000100:00100000:3.0:1787827171.222721:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882432 00000100:00100000:1.0:1787827171.222726:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787827171.222727:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882432 00000100:00100000:1.0:1787827171.222741:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf971a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580882560:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787827171.222759:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787827171.222770:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580882432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787827171.222786:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:3.0:1787827171.222791:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787827171.222835:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87565680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1874672580882432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.222844:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787827171.222849:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf971a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580882560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.222858:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787827171.222889:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1874672580882432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827171.222900:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580882560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787827171.536307:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827171.536361:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827171.536362:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440064 00000100:00100000:3.0:1787827171.536374:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440064 00000100:00100000:2.0:1787827171.536419:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827171.536446:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440192 00000100:00100000:2.0:1787827171.536455:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787827171.536456:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440192 00000100:00100000:3.0:1787827171.536469:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 269 00000100:00100000:3.0:1787827171.536487:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2396:x1874672572440064:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827171.536538:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440320 00000100:00100000:0.0:1787827171.536544:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440320 00000100:00100000:2.0:1787827171.536573:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827171.536584:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2396:x1874672572440064:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.536592:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1787827171.536598:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 269 00000100:00100000:0.0:1787827171.536629:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2397:x1874672572440192:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787827171.536696:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440448 00000100:00100000:3.0:1787827171.536704:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440448 00000100:00100000:0.0:1787827171.536710:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2397:x1874672572440192:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 99us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.536722:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:2.0:1787827171.536750:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440576 00000100:00100000:0.0:1787827171.536756:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1787827171.536757:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440576 00000100:00100000:0.0:1787827171.536769:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf972940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572440320:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827171.536812:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf972940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572440320:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 47us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.536821:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00080000:0.0:1787827171.536858:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787827171.536868:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787827171.536875:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787827171.536878:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787827171.536883:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1787827171.536964:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787827171.536969:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf972580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572440448:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827171.536990:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbf970f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572440576:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827171.537032:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf970f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2396:x1874672572440576:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.537040:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787827171.537139:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbf972580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572440448:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 175us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.537152:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000001:02000400:3.0:1787827171.644813:0:12151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 06:39:30 (1787827170) === 00000100:00100000:3.0:1787827171.734579:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827171.734602:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580882816:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.734648:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580882944:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.734733:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827171.734745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.734746:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.734780:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd366940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580883072:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.734833:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.734835:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd365e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580883456:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.734837:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd367840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580883200:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.734872:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd364b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580883584:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.734880:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.734886:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.734914:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580883968:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.734931:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd365680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580883712:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.734938:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.734967:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1874672580884096:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.734972:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.734980:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827171.735004:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd3661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580883328:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.735027:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.735027:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd366580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580884224:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735051:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882816 00000100:00100000:0.0:1787827171.735060:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882816 00000100:00100000:1.0:1787827171.735111:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882944 00000100:00100000:1.0:1787827171.735120:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882944 00000100:00100000:2.0:1787827171.735136:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883456 00000100:00100000:0.0:1787827171.735138:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787827171.735140:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827171.735145:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883456 00000100:00100000:0.0:1787827171.735171:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3616:x1874672580882816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.735178:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883584 00000100:00100000:1.0:1787827171.735183:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883584 00000100:00100000:2.0:1787827171.735209:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883968 00000100:00100000:2.0:1787827171.735216:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883968 00000100:00100000:3.0:1787827171.735218:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580882688 00000100:00100000:3.0:1787827171.735226:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580882688 00000100:00100000:1.0:1787827171.735227:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884096 00000100:00100000:0.0:1787827171.735244:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3616:x1874672580882816:12345-0@lo:400:kworker.0 Request processed in 90us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.735246:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884096 00000100:00100000:2.0:1787827171.735252:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787827171.735266:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787827171.735271:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580882944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.735284:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787827171.735298:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580882688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827171.735312:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00002000:00000024:3.0:1787827171.735329:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827171.735330:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787827171.735330:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87566d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1874672580882944:12345-0@lo:400:kworker.0 Request processed in 66us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827171.735340:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580883456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735351:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580883584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.735359:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787827171.735418:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580882688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.735423:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787827171.735432:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787827171.735438:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735460:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580883584:12345-0@lo:400:kworker.0 Request processed in 116us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.735465:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883072 00000100:00100000:0.0:1787827171.735471:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787827171.735472:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883072 00000100:00100000:2.0:1787827171.735501:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580883968:12345-0@lo:400:kworker.0 Request processed in 65us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.735507:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787827171.735514:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580883456:12345-0@lo:400:kworker.0 Request processed in 182us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.735520:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787827171.735521:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883200 00000100:00100000:0.0:1787827171.735528:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd364f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1874672580884096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.735530:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883200 00000100:00100000:1.0:1787827171.735543:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787827171.735573:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787827171.735581:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787827171.735586:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd364780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580883072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735593:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd364f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1874672580884096:12345-0@lo:400:kworker.0 Request processed in 74us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.735597:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580883200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735618:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787827171.735656:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787827171.735663:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827171.735670:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd364780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580883072:12345-0@lo:400:kworker.0 Request processed in 82us (834us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827171.735672:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827171.735682:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580883200:12345-0@lo:400:kworker.0 Request processed in 83us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.735684:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd366940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580883072:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.735688:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787827171.735705:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787827171.735724:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd364b40 x1874672580883584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827171.735738:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd364b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580883584:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.735748:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd367840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580883200:0@lo:400:kworker.0 00010000:00080000:0.0:1787827171.735757:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd3670c0 x1874672580884096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827171.735773:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1874672580884096:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.735777:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787827171.735778:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40f840 x1874672580882688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827171.735782:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883712 00000100:00100000:1.0:1787827171.735791:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883712 00000100:00100000:3.0:1787827171.735807:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787827171.735808:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827171.735818:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd366d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580883840:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735825:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580884480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827171.735849:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884224 00000100:00100000:1.0:1787827171.735855:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884224 00000100:00100000:2.0:1787827171.735863:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.735880:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827171.735898:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd365e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580883456:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.735903:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580884352:0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.735926:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580883968:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.735927:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883840 00000100:00100000:1.0:1787827171.735939:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883840 00000100:00100000:2.0:1787827171.735941:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827171.735947:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787827171.735949:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a86725680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1874672580882944:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.735966:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580883712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.735988:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884352 00000100:00100000:2.0:1787827171.735989:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf973c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a7d14451-881f-46a5-81e7-5eca8cfcf000:3616:1874672580882816:0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.735992:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884352 00000100:00100000:3.0:1787827171.736017:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787827171.736032:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580883712:12345-0@lo:400:kworker.0 Request processed in 72us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827171.736036:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580884224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.736049:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787827171.736057:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787827171.736058:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd365a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580883840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.736071:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787827171.736086:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd367c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580884352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827171.736096:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580884224:12345-0@lo:400:kworker.0 Request processed in 68us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.736100:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884480 00000100:00100000:3.0:1787827171.736104:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787827171.736106:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884480 00000100:00100000:1.0:1787827171.736148:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd365a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580883840:12345-0@lo:400:kworker.0 Request processed in 87us (283us total) trans 0 rc 0/0 00010000:00080000:3.0:1787827171.736156:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd365680 x1874672580883712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827171.736160:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787827171.736160:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd367c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580884352:12345-0@lo:400:kworker.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.736177:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87566580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580884480:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787827171.736188:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787827171.736198:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd365680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580883712:0@lo:400:kworker.0 00002000:00000024:0.0:1787827171.736200:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787827171.736209:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787827171.736235:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd366580 x1874672580884224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827171.736242:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827171.736248:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd366580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580884224:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.736252:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580883328 00000100:00100000:2.0:1787827171.736259:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580883328 00000100:00100000:0.0:1787827171.736264:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87566580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580884480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827171.736277:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787827171.736293:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd366d00 x1874672580883840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827171.736307:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd366d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580883840:0@lo:400:kworker.0 00000100:00100000:2.0:1787827171.736329:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787827171.736335:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd367480 x1874672580884352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787827171.736336:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40de00 x1874672580884480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787827171.736352:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580883328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827171.736430:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580884352:0@lo:400:kworker.0 00000100:00100000:0.0:1787827171.736443:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580884480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787827171.736445:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580883328:12345-0@lo:400:kworker.0 Request processed in 101us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827171.736460:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787827171.736490:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd3661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580883328:0@lo:400:kworker.0 00010000:00010000:2.0:1787827171.990560:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787827173.014548:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787827173.504871:0:12343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787827174.038487:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787827175.062473:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787827175.830534:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a877a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580884608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827175.830572:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787827175.830613:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a875643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580884736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787827175.830626:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787827175.830697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827175.830698:0:10314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884608 00000100:00100000:2.0:1787827175.830709:0:10314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884608 00000100:00100000:3.0:1787827175.830748:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884736 00000100:00100000:3.0:1787827175.830756:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884736 00000100:00080000:0.0:1787827175.830768:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827175.830801:0:10314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787827175.830816:0:10314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580884608:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827175.830834:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787827175.830847:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580884736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787827175.830858:0:10314:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1787827175.830863:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787827175.830926:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580884736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827175.830936:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787827175.830941:0:10314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580884608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827175.830952:0:10314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787827175.830961:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a877a5680 x1874672580884608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787827175.830986:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a875643c0 x1874672580884736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787827175.830987:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a877a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580884608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787827175.831016:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a875643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580884736:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1787827176.062760:0:12658:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827176.062920:0:12658:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787827176.086522:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787827176.342532:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787827176.342538:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787827176.342553:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580884864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787827176.342554:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a87564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580884992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827176.342627:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.342658:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884864 00000100:00100000:1.0:1787827176.342665:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.342666:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884864 00000100:00100000:0.0:1787827176.342705:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580884992 00000100:00100000:0.0:1787827176.342710:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580884992 00000100:00100000:3.0:1787827176.342721:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787827176.342734:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd365e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580884864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787827176.342739:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787827176.342750:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580884992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787827176.342769:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:1.0:1787827176.342772:0:7448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787827176.342826:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580884992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.342834:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787827176.342844:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd365e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580884864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.342854:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787827176.342873:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a87564f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580884992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787827176.342885:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580884864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787827176.656417:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787827176.656504:0:7426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440704 00000100:00100000:3.0:1787827176.656514:0:7426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440704 00000100:00100000:3.0:1787827176.656579:0:7426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 271 00000100:00100000:3.0:1787827176.656589:0:7426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2397:x1874672572440704:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787827176.656601:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827176.656660:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440960 00000100:00100000:2.0:1787827176.656665:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440960 00000100:00080000:0.0:1787827176.656706:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787827176.656720:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1787827176.656728:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87564f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572440960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827176.656774:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87564f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2397:x1874672572440960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.656791:0:7426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8baa98b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0bb8b105-f59c-455a-b6b1-ce40efc3999c+10:2397:x1874672572440704:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 202us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.656804:0:7426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 271 00000100:00100000:2.0:1787827176.656810:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1787827176.656815:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827176.656836:0:8120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572440832 00000100:00100000:2.0:1787827176.656840:0:8120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572440832 00000100:00080000:0.0:1787827176.656865:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787827176.656869:0:8120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:2.0:1787827176.656877:0:8120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2397:x1874672572440832:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787827176.656901:0:8120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+6:2397:x1874672572440832:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787827176.656906:0:8120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1787827176.659941:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787827176.659994:0:9450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572441088 00000100:00100000:2.0:1787827176.660001:0:9450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572441088 00000100:00080000:0.0:1787827176.660040:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787827176.660052:0:9450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1787827176.660064:0:9450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2393:x1874672572441088:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1787827176.660092:0:9450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb2e8bd65d71dda1a 00000100:00080000:2.0:1787827176.660101:0:9450:0:(import.c:65:import_set_state_nolock()) ffff8f8a86728000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787827176.660107:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:3.0:1787827176.660141:0:7441:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787827176.660146:0:9450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787827176.660155:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672572441216 00000100:00100000:0.0:1787827176.660162:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672572441216 00000100:00100000:0.0:1787827176.660205:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1787827176.660216:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+5:2393:x1874672572441216:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:0.0:1787827176.660239:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb2e8bd65d71dda21 00000100:00080000:0.0:1787827176.660249:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8f8bbacab000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787827176.660275:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787827176.660285:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787827176.660305:0:9450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87564780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cef8de3-2326-42de-9d41-f4cb057ed6e8+2:2393:x1874672572441088:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 243us (365us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827176.660307:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787827176.660314:0:9450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:0.0:1787827176.660433:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd40ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cef8de3-2326-42de-9d41-f4cb057ed6e8+2:2393:x1874672572441216:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 219us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.660452:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000020:00000004:2.0:1787827176.725456:0:12755:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827176.725618:0:12755:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787827176.854480:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580885120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787827176.854497:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a87564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580885248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827176.854544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.854591:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.854618:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787827176.854623:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787827176.854627:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1874672580885504:0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.854632:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580885376:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.854661:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.854672:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.854686:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580885632:0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.854713:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580885760:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.854721:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.854735:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580886016:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.854742:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580886144:0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.854749:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.854773:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.854781:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580886272:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.854793:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885504 00000100:00100000:3.0:1787827176.854799:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885504 00000100:00100000:1.0:1787827176.854805:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b92997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580886528:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.854811:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885248 00000100:00100000:0.0:1787827176.854815:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885248 00000100:00100000:3.0:1787827176.854832:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886016 00000100:00100000:1.0:1787827176.854834:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.854837:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886016 00000100:00100000:0.0:1787827176.854853:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885120 00000100:00100000:0.0:1787827176.854856:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885120 00000100:00100000:1.0:1787827176.854857:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787827176.854865:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886528 00000100:00100000:3.0:1787827176.854869:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886528 00000100:00100000:1.0:1787827176.854870:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8a875fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580886656:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.854885:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787827176.854897:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580885248:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787827176.854897:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787827176.854898:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.854908:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1874672580885504:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787827176.854923:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787827176.854931:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885632 00000100:00100000:1.0:1787827176.854937:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885632 00000100:00100000:3.0:1787827176.854948:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1874672580885504:12345-0@lo:400:kworker.0 Request processed in 41us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.854955:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787827176.854962:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1874672580885248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.854969:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787827176.854970:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886656 00000100:00100000:1.0:1787827176.854973:0:7448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885760 00000100:00100000:3.0:1787827176.854976:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886656 00000100:00100000:1.0:1787827176.854977:0:7448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885760 00000100:00100000:0.0:1787827176.854984:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787827176.854991:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580885120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827176.855000:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00002000:00000024:0.0:1787827176.855001:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787827176.855007:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787827176.855011:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a877a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580885632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855021:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855023:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1874672580885120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.855032:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787827176.855049:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a877a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1874672580885632:12345-0@lo:400:kworker.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.855056:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787827176.855061:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787827176.855069:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1874672580886016:12345-0@lo:400:kworker.0 Request processed in 53us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.855070:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580886528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.855079:0:7448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787827176.855083:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787827176.855091:0:7448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd367840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580885760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855100:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787827176.855106:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1874672580886528:12345-0@lo:400:kworker.0 Request processed in 38us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.855111:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855118:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787827176.855130:0:7448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd367840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580885760:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.855135:0:7448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787827176.855145:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580885888:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855152:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1874672580886656:12345-0@lo:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00080000:1.0:1787827176.855154:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787827176.855158:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787827176.855162:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787827176.855162:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787827176.855175:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787827176.855183:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885888 00000100:00100000:3.0:1787827176.855187:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885888 00010000:00080000:1.0:1787827176.855191:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a875fad00 x1874672580886656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827176.855200:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580886400:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.855209:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a875fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1874672580886656:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.855225:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1874672580886016:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855226:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787827176.855232:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.855238:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b92997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1874672580886528:0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855240:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a87565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855293:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886400 00000100:00100000:3.0:1787827176.855294:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a87565e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874672580885888:12345-0@lo:400:kworker.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787827176.855296:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886400 00000100:00100000:3.0:1787827176.855305:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787827176.855317:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580885376 00000100:00100000:1.0:1787827176.855321:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580885376 00000100:00100000:0.0:1787827176.855324:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787827176.855332:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a875661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580886400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787827176.855349:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874672580885888:0@lo:400:kworker.0 00000100:00100000:1.0:1787827176.855358:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00010000:00080000:3.0:1787827176.855365:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8b929952c0 x1874672580886400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827176.855369:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3615:x1874672580885376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855370:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a875661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874672580886400:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787827176.855411:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8b929952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1874672580886400:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855413:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787827176.855418:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bb1a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7d14451-881f-46a5-81e7-5eca8cfcf000+24:3615:x1874672580885376:12345-0@lo:400:kworker.0 Request processed in 52us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.855424:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787827176.855458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787827176.855464:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787827176.855479:0:10054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886144 00000100:00100000:1.0:1787827176.855482:0:10054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886144 00000100:00100000:3.0:1787827176.855492:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1874672580885504:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855507:0:9452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874672580886272 00000100:00100000:2.0:1787827176.855507:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a7d14451-881f-46a5-81e7-5eca8cfcf000:3615:1874672580885376:0@lo:400:kworker.0 00010000:00080000:3.0:1787827176.855511:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8a87564b40 x1874672580885248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827176.855512:0:9452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874672580886272 00000100:00100000:1.0:1787827176.855525:0:10054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787827176.855528:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8a87564b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1874672580885248:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787827176.855535:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40f0c0 x1874672580885120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787827176.855539:0:10054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8a86725680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855548:0:9452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787827176.855551:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1874672580885632:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855561:0:9452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8bbd3670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580886272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787827176.855561:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1874672580885120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787827176.855596:0:10054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8a86725680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1874672580886144:12345-0@lo:400:kworker.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787827176.855603:0:10054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787827176.855607:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580885760:0@lo:400:kworker.0 00010000:00080000:3.0:1787827176.855612:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbd40c000 x1874672580886144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787827176.855618:0:9452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8bbd3670c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1874672580886272:12345-0@lo:400:kworker.0 Request processed in 60us (152us total) trans 0 rc 0/0 00010000:00080000:2.0:1787827176.855623:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f8bbf9c5a40 x1874672580886272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787827192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787827176.855624:0:6480:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787827176.855624:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbd40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1874672580886144:0@lo:400:kworker.0 00000100:00100000:0.0:1787827176.855629:0:9452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787827176.855638:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f8bbf9c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1874672580886272:0@lo:400:kworker.0 00010000:00010000:0.0:1787827177.111514:0:6473:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787827177.391710:0:12852:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787827177.391960:0:12852:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787827178.091591:0:12950:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787827178.091774:0:12950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787827178.134597:0:10354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787827178.729882:0:13047:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787827178.730083:0:13047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 Debug log: 10274 lines, 10274 kept, 0 dropped, 0 bad.